| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-28 | 1 | -59/+59 |
| | | | | | | | This commit fixes the style issues introduced in d0b0fa9 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/102 | ||||
| * | Merge branch 'development' into feature/load-lambda-tests | Ellie | 2024-08-28 | 1 | -59/+26 |
| |\ | |||||
| | * | Merge branch 'development' into test/transform-helper-functions | bulve-ad | 2024-08-27 | 1 | -2/+197 |
| | |\ | |||||
| | | * | Merge branch 'development' into test/transform-helper-functions | bulve-ad | 2024-08-27 | 2 | -2/+198 |
| | | |\ | |||||
| | | | * | Merge pull request #98 from ajschofield/test/transform-helper-functions | bulve-ad | 2024-08-27 | 1 | -57/+54 |
| | | | |\ | | | | | | | | | | | pr: refactored facts transformation functions and one test for it | ||||
| | | | | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-27 | 1 | -78/+156 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in a05a371 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/98 | ||||
| | | * | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-27 | 1 | -78/+152 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 22df92b according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/99 | ||||
| | * | | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-27 | 2 | -80/+161 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 1a145a3 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/101 | ||||
| | * | | | | test: transform refactoring - it now loads parquet files into s3 bucket | Ang Bel | 2024-08-27 | 2 | -19/+19 |
| | |/ / / | |||||
| | * | / | test: refactored fact functions with test passing | Ang Bel | 2024-08-27 | 1 | -12/+12 |
| | | |/ | |/| | |||||
| | * | | test: fact transformation function for payment test passes, other fact ↵ | Ang Bel | 2024-08-27 | 1 | -166/+85 |
| | | | | | | | | | | | | | functions are equivalent, no tests written | ||||
| * | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-28 | 1 | -85/+97 |
| | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 08c971f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/102 | ||||
| * | | | add json.loads | Ellie | 2024-08-28 | 1 | -4/+5 |
| | | | | |||||
| * | | | amend to inner join | Ellie | 2024-08-28 | 1 | -3/+3 |
| | | | | |||||
| * | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-28 | 1 | -0/+50 |
| | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in a05a371 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/98 | ||||
| * | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-28 | 2 | -80/+161 |
| | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 1a145a3 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/101 | ||||
| * | | | test: transform refactoring - it now loads parquet files into s3 bucket | Ang Bel | 2024-08-28 | 2 | -19/+19 |
| | | | | |||||
| * | | | test: refactored fact functions with test passing | Ang Bel | 2024-08-28 | 1 | -12/+12 |
| | | | | |||||
| * | | | test: fact transformation function for payment test passes, other fact ↵ | Ang Bel | 2024-08-28 | 1 | -166/+85 |
| | | | | | | | | | | | | | functions are equivalent, no tests written | ||||
| * | | | add logger error to lambda handler | Ellie | 2024-08-27 | 1 | -5/+7 |
| | | | | |||||
| * | | | wip: update TestLambdaHandler & lambda_handler function | Alex Schofield | 2024-08-27 | 1 | -8/+11 |
| | | | | |||||
| * | | | refactor: add parameter for sm_secret | Alex Schofield | 2024-08-27 | 1 | -3/+6 |
| | | | | |||||
| * | | | add json.loads to retrieve secrests function | Ellie | 2024-08-27 | 1 | -6/+9 |
| | | | | |||||
| * | | | remove import as not required | Ellie | 2024-08-27 | 1 | -3/+5 |
| | |/ |/| | |||||
| * | | Merge branch 'development' into feature/load-lambda | Ellie | 2024-08-27 | 2 | -5/+413 |
| |\| | |||||
| | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-27 | 2 | -41/+39 |
| | | | | | | | | | | | | | This commit fixes the style issues introduced in c68f63f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/97 | ||||
| | * | wip: refactored fact payment function | lian-manonog | 2024-08-27 | 2 | -8/+9 |
| | | | |||||
| | * | wip: added a bracket in dataframes | lian-manonog | 2024-08-27 | 2 | -3/+4 |
| | | | |||||
| | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-23 | 1 | -35/+41 |
| | | | | | | | | | | | | | This commit fixes the style issues introduced in 8f75a47 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96 | ||||
| | * | Merge branch 'test/test_transform_lambda' into test/dataframes | bulve-ad | 2024-08-23 | 6 | -248/+194 |
| | |\ | |||||
| | | * | wip: pushing again | lian-manonog | 2024-08-23 | 2 | -6/+7 |
| | | | | |||||
| | | * | Merge pull request #94 from ajschofield/feature/transform-fact-sales-order | lian-manonog | 2024-08-23 | 2 | -5/+484 |
| | | |\ | | | | | | | | | PR: rebased the fact-sales branch with the datafrrames branch - now merging into development | ||||
| | | | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-23 | 1 | -3/+6 |
| | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 3ff2182 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93 | ||||
| | | | * | trying to resolce git index issue conflicts - commiting was the only solution | lian-manonog | 2024-08-23 | 1 | -9/+4 |
| | | | | | |||||
| | | | * | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-23 | 2 | -157/+236 |
| | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93 | ||||
| | | | * | Deleted the fact_table schema py files | lian-manonog | 2024-08-23 | 4 | -233/+157 |
| | | | | | | | | | | | | | | | | | | | | | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas | ||||
| | * | | | style: format code with Autopep8, Black and Ruff Formatter | deepsource-autofix[bot] | 2024-08-23 | 1 | -96/+154 |
| | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 821e241 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96 | ||||
| | * | | | tests: additional tests written (pass) for dim tables transformation. Fact ↵ | Ang Bel | 2024-08-23 | 1 | -14/+16 |
| | | | | | | | | | | | | | | | | | transformation functions not yet tested | ||||
| | * | | | fix: refactoring for create_dim_date to include all date columns from all ↵ | Ang Bel | 2024-08-23 | 1 | -20/+13 |
| | | | | | | | | | | | | | | | | | fact dfs, tested on dummy data. Tests are not written | ||||
| | * | | | removed duplicate functions | T-Aji | 2024-08-23 | 1 | -89/+28 |
| | | |/ | |/| | |||||
| | * | | dataframes combined into one file | T-Aji | 2024-08-23 | 1 | -0/+238 |
| | | | | |||||
| | * | | Merge branch 'feature/transform-fact-sales-order' of ↵ | T-Aji | 2024-08-23 | 2 | -5/+53 |
| | |\ \ | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order | ||||
| | | * | | wip: wrote pseudocode for lambda handler in writing df to parquet file ↵ | lian-manonog | 2024-08-22 | 2 | -5/+53 |
| | | | | | | | | | | | | | | | | | format and uploading the parquet files | ||||
| | * | | | payment schema added | T-Aji | 2024-08-23 | 2 | -2/+46 |
| | |/ / | |||||
| | * | | complete code for tables for purchase schema including a scrape for ↵ | Ang Bel | 2024-08-22 | 1 | -18/+48 |
| | | | | | | | | | | | | | currency table. Test to be done | ||||
| | * | | add fact table | T-Aji | 2024-08-22 | 1 | -50/+0 |
| | | | | |||||
| | * | | Merge branch 'feature/transform-fact-sales-order' of ↵ | T-Aji | 2024-08-22 | 1 | -23/+30 |
| | |\ \ | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order | ||||
| | | * | | refactored approach to writing transformation as functions per df. WIP | Ang Bel | 2024-08-22 | 1 | -23/+30 |
| | | | | | |||||
| | * | | | add fact table | T-Aji | 2024-08-22 | 1 | -4/+31 |
| | |/ / | |||||
| | * | | passing tests create_dim_design and create_dim_staff | T-Aji | 2024-08-22 | 1 | -0/+50 |
| | | | | |||||
 |
index : de-project-bentley | |
| Northcoders project - ETL pipeline with AWS | Alex Schofield |
| aboutsummaryrefslogtreecommitdiffstats |