BRIGHT’s Three-Times-a-Day Data Refresh
BRIGHT’s data is updated three times per day in an 8-hour cycle. This involves:
-
Extract & Rebuild:
- An ETL (Extract-Transform-Load) script runs to fetch data from the FL3XX backend tables and rebuild the full dataset.
- This process starts every 8 hours, then takes around 3 hours to complete.
-
Datasets (Quicksight) Refresh:
- After the dataset refresh, BRIGHT (powered by Amazon Quicksight) refreshes its datasets, dashboards, and reports.
- This final step ensures that you have access to the newly rebuilt data in your BRIGHT dashboards.
Below is a breakdown of how it looks for each region:
- US Region (us-east-1.quicksight)
- ETL Start Times: 06:00, 14:00, 22:00 UTC
- ETL Completion: ~3 hours later
- Dataset Refresh (Quicksight): ~4 hours after the start, i.e., at 10:00, 18:00, and 02:00 UTC (next day)
- EU Region (eu-central-1.quicksight)
- ETL Start Times: 03:00, 11:00, 19:00 UTC
- ETL Completion: ~3 hours later
- Dataset Refresh (Quicksight): ~4 hours after the start, i.e., at 07:00, 15:00, and 23:00 UTC
Example: Data entered in the EU Region at 02:59 UTC will appear in BRIGHT dashboards by 07:00 UTC that same day.