| Commit message (Collapse) | Author | Age | Files | Lines | ||
|---|---|---|---|---|---|---|
| ... | ||||||
| | * | | | Merge pull request #89 from ajschofield/alex/re-add-sm-test | Alex | 2024-08-22 | 1 | -0/+84 | |
| | |\ \ \ | | | | | | | | | | | pr: re-add test_secrets_manager | |||||
| | | * | | | test: re-add test_secrets_manager | Alex | 2024-08-22 | 1 | -0/+84 | |
| | |/ / / | | | | | | | | | Amended import path to extract_lambda | |||||
| | * | | | Merge pull request #88 from ajschofield/alex/rm-sm-test | Alex | 2024-08-21 | 1 | -84/+0 | |
| | |\ \ \ | | | | | | | | | | | pr: delete test for secrets_manager.py | |||||
| | | * | | | chore: delete test for secrets_manager.py | Alex | 2024-08-21 | 1 | -84/+0 | |
| | |/ / / | | | | | | | | | We don't need this anymore since we removed the secrets_manager.py file, and it's making the GH Action fail too. | |||||
| | * | | | Merge pull request #87 from ajschofield/ci/add-pythonpath | Alex | 2024-08-21 | 1 | -0/+3 | |
| | |\ \ \ | | | | | | | | | | | pr: update dev-tests.yml | |||||
| | | * | | | ci: update dev-tests.yml | Alex | 2024-08-21 | 1 | -0/+3 | |
| | |/ / / | ||||||
| | * | | | Merge pull request #86 from ajschofield/alex/fix-ci | Alex | 2024-08-21 | 1 | -0/+1 | |
| | |\ \ \ | | | | | | | | | | | pr: update dev-tests.yml | |||||
| | | * | | | Update dev-tests.yml | Alex | 2024-08-21 | 1 | -0/+1 | |
| | |/ / / | ||||||
| | | | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-23 | 2 | -155/+330 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 821e241 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96 | |||||
| | | | * | tests: additional tests written (pass) for dim tables transformation. Fact ↵ | Ang Bel | 2024-08-23 | 2 | -61/+82 | |
| | | | | | | | | | | | | | | | | | transformation functions not yet tested | |||||
| | | | * | fix: refactoring for create_dim_date to include all date columns from all ↵ | Ang Bel | 2024-08-23 | 1 | -20/+13 | |
| | | | | | | | | | | | | | | | | | fact dfs, tested on dummy data. Tests are not written | |||||
| | | | * | removed duplicate functions | T-Aji | 2024-08-23 | 1 | -16/+69 | |
| | | | | | ||||||
| | | | * | removed duplicate functions | T-Aji | 2024-08-23 | 1 | -89/+28 | |
| | | |/ | ||||||
| | | * | dataframes combined into one file | T-Aji | 2024-08-23 | 1 | -0/+238 | |
| | | | | ||||||
| | | * | Merge branch 'feature/transform-fact-sales-order' of ↵ | T-Aji | 2024-08-23 | 4 | -10/+62 | |
| | | |\ | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order | |||||
| | | | * | wip: wrote pseudocode for lambda handler in writing df to parquet file ↵ | lian-manonog | 2024-08-22 | 3 | -6/+56 | |
| | | | | | | | | | | | | | | | | | format and uploading the parquet files | |||||
| | | | * | Refactored tests for transform lambda - all passing now | lian-manonog | 2024-08-22 | 1 | -4/+6 | |
| | | | | | ||||||
| | | * | | payment schema added | T-Aji | 2024-08-23 | 2 | -2/+46 | |
| | | |/ | ||||||
| | | * | complete code for tables for purchase schema including a scrape for ↵ | Ang Bel | 2024-08-22 | 1 | -18/+48 | |
| | | | | | | | | | | | | | currency table. Test to be done | |||||
| | | * | add fact table | T-Aji | 2024-08-22 | 1 | -50/+0 | |
| | | | | ||||||
| | | * | Merge branch 'feature/transform-fact-sales-order' of ↵ | T-Aji | 2024-08-22 | 1 | -23/+30 | |
| | | |\ | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order | |||||
| | | | * | refactored approach to writing transformation as functions per df. WIP | Ang Bel | 2024-08-22 | 1 | -23/+30 | |
| | | | | | ||||||
| | | * | | add fact table | T-Aji | 2024-08-22 | 1 | -4/+31 | |
| | | |/ | ||||||
| | | * | passing TestCreateDimCurrency | T-Aji | 2024-08-22 | 1 | -1/+18 | |
| | | | | ||||||
| | | * | passing tests create_dim_design and create_dim_staff | T-Aji | 2024-08-22 | 2 | -0/+90 | |
| | | | | ||||||
| | | * | refactor df creation into func | T-Aji | 2024-08-22 | 1 | -70/+34 | |
| | | | | ||||||
| | | * | wip: creating dim dataframes | T-Aji | 2024-08-22 | 3 | -9/+58 | |
| | | |\ | ||||||
| | | | * | wip: fact_purchase_order schema | lian-manonog | 2024-08-21 | 3 | -3/+37 | |
| | | | | | ||||||
| | | | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-21 | 1 | -18/+68 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 20a3bd8 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/85 | |||||
| | | * | | began dim_date df | T-Aji | 2024-08-21 | 1 | -18/+17 | |
| | | |/ | ||||||
| | | * | Merge branch 'feature/transform-fact-sales-order' of ↵ | T-Aji | 2024-08-21 | 0 | -0/+0 | |
| | | |\ | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order | |||||
| | | | * | add dim tables: design, staff, currency, location (wip) | Ellie | 2024-08-21 | 1 | -0/+54 | |
| | |_|/ |/| | | ||||||
| * | | | ci: rm dev-test.yml | Alex | 2024-08-20 | 1 | -49/+0 | |
| | | | | | | | | | | It's in the wrong branch... | |||||
| * | | | ci: update dev-test.yml | Alex | 2024-08-20 | 1 | -0/+1 | |
| | | | | ||||||
| * | | | ci: add dev-test.yml | Alex | 2024-08-20 | 1 | -0/+48 | |
| | | | | ||||||
| * | | | Merge pull request #80 from ajschofield/development | Alex | 2024-08-20 | 1 | -0/+1 | |
| |\ \ \ | | | | | | | | | pr: github actions trigger deployment only if ref is main | |||||
| | | | * | 5 dim tables created | T-Aji | 2024-08-21 | 1 | -15/+33 | |
| | | | | | ||||||
| | | | * | add dim tables: design, staff, currency, location (wip) | Ellie | 2024-08-21 | 1 | -0/+54 | |
| | | | | | ||||||
| | | | * | ci: rm dev-test.yml | Alex | 2024-08-21 | 1 | -49/+0 | |
| | | | | | | | | | | | | | It's in the wrong branch... | |||||
| | | | * | ci: update dev-test.yml | Alex | 2024-08-21 | 1 | -0/+1 | |
| | | | | | ||||||
| | | | * | ci: add dev-test.yml | Alex | 2024-08-21 | 1 | -0/+48 | |
| | | |/ | ||||||
| | | * | Merge pull request #84 from ajschofield/feature/transform_lambda | bulve-ad | 2024-08-21 | 4 | -4/+120 | |
| | | |\ | | | | | | | | | Feature/transform lambda read from s3 into df | |||||
| | | | * | Merge branch 'development' into feature/transform_lambda | bulve-ad | 2024-08-21 | 24 | -487/+676 | |
| | | | |\ | | | |/ | | |/| | ||||||
| | | * | | Merge pull request #83 from ajschofield/ci/add-dev-tests-yml | Alex | 2024-08-20 | 1 | -0/+48 | |
| | | |\ \ | | | | | | | | | | | pr: create dev-tests.yml | |||||
| | | | * | | ci: remove environment for dev-tests.yml | Alex | 2024-08-20 | 1 | -1/+0 | |
| | | | | | | ||||||
| | | | * | | ci: create dev-tests.yml | Alex | 2024-08-20 | 1 | -0/+49 | |
| | | |/ / | ||||||
| | | * | | Merge pull request #82 from ajschofield/test/test-branch | Alex | 2024-08-20 | 1 | -2/+2 | |
| | | |\ \ | | | | | | | | | | | test: test trigger for ci/cd | |||||
| | | | * | | test: test trigger for ci/cd | Alex Schofield | 2024-08-20 | 1 | -2/+2 | |
| | | |/ / | ||||||
| | | * | | Merge pull request #81 from ajschofield/alex/remove-dev-ga-workflow | Alex | 2024-08-20 | 1 | -43/+0 | |
| | |/| | | | | | | | | | | chore: rm workflow file from development | |||||
| | | * | | chore: rm workflow file from development | Alex | 2024-08-20 | 1 | -43/+0 | |
| | |/ / | ||||||
 |
index : de-project-bentley | |
| Northcoders project - ETL pipeline with AWS | Alex Schofield |
| aboutsummaryrefslogtreecommitdiffstats |