diff options
| author | Alex Schofield <git@ajschof.me> | 2024-08-16 11:09:59 +0100 |
|---|---|---|
| committer | Alex Schofield <git@ajschof.me> | 2024-08-16 11:09:59 +0100 |
| commit | 67a3caf058416718e9413520cb74be049af1e93e (patch) | |
| tree | a6b77eb6641258250b47840e0a15b5a338b2d27f | |
| parent | 37eb3bb7974904614867c7d0c2d4f6eccb39f22e (diff) | |
| download | de-project-bentley-67a3caf058416718e9413520cb74be049af1e93e.tar.gz de-project-bentley-67a3caf058416718e9413520cb74be049af1e93e.zip | |
docs: add draft key features section
| -rw-r--r-- | README.md | 15 |
1 files changed, 14 insertions, 1 deletions
@@ -21,4 +21,17 @@ can: 1. Extract the data from the `totesys` operational database 2. Store the data in AWS S3 buckets, that will form our data lake 3. Transform the data into a suitable schema for the data warehouse -4. Load the transformed data into the data warehouse hosted on AWS
\ No newline at end of file +4. Load the transformed data into the data warehouse hosted on AWS + +# Key Features + +We aim for the project to have certain features. Some are more prioritised than +others. + +- [ ] Automated data ingestion from `totesys` db +- [ ] Data storage for ingested and processed data in S3 buckets +- [ ] Data transformation for data warehouse schema +- [ ] Automated data loading into the data warehouse schema +- [ ] Logging and monitoring with CloudWatch +- [ ] Notifications for errors and successful runs (e.g. successful ingestion) +- [ ] Visualisation of warehouse data
\ No newline at end of file |