BRIGHT’s Three-Times-a-Day Data Refresh

BRIGHT’s data is updated three times per day in an 8-hour cycle. This involves:

  1. Extract & Rebuild:

    • An ETL (Extract-Transform-Load) script runs to fetch data from the FL3XX backend tables and rebuild the full dataset.
    • This process starts every 8 hours, then takes around 3 hours to complete.
  2. Datasets (Quicksight) Refresh:

    • After the dataset refresh, BRIGHT (powered by Amazon Quicksight) refreshes its datasets, dashboards, and reports.
    • This final step ensures that you have access to the newly rebuilt data in your BRIGHT dashboards.

Below is a breakdown of how it looks for each region:

  • US Region (us-east-1.quicksight)
    • ETL Start Times: 06:00, 14:00, 22:00 UTC
    • ETL Completion: ~3 hours later
    • Dataset Refresh (Quicksight): ~4 hours after the start, i.e., at 10:00, 18:00, and 02:00 UTC (next day)
  • EU Region (eu-central-1.quicksight)
    • ETL Start Times: 03:00, 11:00, 19:00 UTC
    • ETL Completion: ~3 hours later
    • Dataset Refresh (Quicksight): ~4 hours after the start, i.e., at 07:00, 15:00, and 23:00 UTC

Example: Data entered in the EU Region at 02:59 UTC will appear in BRIGHT dashboards by 07:00 UTC that same day.