aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
| * | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-234-180/+319
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
| * | | Deleted the fact_table schema py fileslian-manonog2024-08-234-233/+157
| | | | | | | | | | | | | | | | | | | | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-155/+330
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 821e241 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96
| | * | tests: additional tests written (pass) for dim tables transformation. Fact ↵Ang Bel2024-08-232-61/+82
| | | | | | | | | | | | | | | | transformation functions not yet tested
| | * | fix: refactoring for create_dim_date to include all date columns from all ↵Ang Bel2024-08-231-20/+13
| | | | | | | | | | | | | | | | fact dfs, tested on dummy data. Tests are not written
| | * | removed duplicate functionsT-Aji2024-08-231-16/+69
| | | |
| | * | removed duplicate functionsT-Aji2024-08-231-89/+28
| |/ /
| * | dataframes combined into one fileT-Aji2024-08-231-0/+238
| | |
| * | Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-234-10/+62
| |\ \ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | * | wip: wrote pseudocode for lambda handler in writing df to parquet file ↵lian-manonog2024-08-223-6/+56
| | | | | | | | | | | | | | | | format and uploading the parquet files
| | * | Refactored tests for transform lambda - all passing nowlian-manonog2024-08-221-4/+6
| | | |
| * | | payment schema addedT-Aji2024-08-232-2/+46
| |/ /
| * | complete code for tables for purchase schema including a scrape for ↵Ang Bel2024-08-221-18/+48
| | | | | | | | | | | | currency table. Test to be done
| * | add fact tableT-Aji2024-08-221-50/+0
| | |
| * | Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-221-23/+30
| |\ \ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | * | refactored approach to writing transformation as functions per df. WIPAng Bel2024-08-221-23/+30
| | | |
| * | | add fact tableT-Aji2024-08-221-4/+31
| |/ /
| * | passing TestCreateDimCurrencyT-Aji2024-08-221-1/+18
| | |
| * | passing tests create_dim_design and create_dim_staffT-Aji2024-08-222-0/+90
| | |
| * | refactor df creation into funcT-Aji2024-08-221-70/+34
| | |
| * | wip: creating dim dataframesT-Aji2024-08-223-9/+58
| |\ \
| | * | wip: fact_purchase_order schemalian-manonog2024-08-213-3/+37
| | | |
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-211-18/+68
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 20a3bd8 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/85
| * | | began dim_date dfT-Aji2024-08-211-18/+17
| |/ /
| * | Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-210-0/+0
| |\ \ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | * | add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | | |
| | * | ci: rm dev-test.ymlAlex2024-08-201-49/+0
| | | | | | | | | | | | It's in the wrong branch...
| | * | ci: update dev-test.ymlAlex2024-08-201-0/+1
| | | |
| | * | ci: add dev-test.ymlAlex2024-08-201-0/+48
| | | |
| | * | Merge pull request #80 from ajschofield/developmentAlex2024-08-201-0/+1
| | |\ \ | | | | | | | | | | pr: github actions trigger deployment only if ref is main
| * | | | 5 dim tables createdT-Aji2024-08-211-15/+33
| | | | |
| * | | | add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | | | |
| * | | | ci: rm dev-test.ymlAlex2024-08-211-49/+0
| | | | | | | | | | | | | | | It's in the wrong branch...
| * | | | ci: update dev-test.ymlAlex2024-08-211-0/+1
| | | | |
| * | | | ci: add dev-test.ymlAlex2024-08-211-0/+48
| | | | |
| | | | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-39/+80
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 0ff2956 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/95
| | | | * add updated testEllie2024-08-231-4/+4
| | | | |
| | | | * add updated testsEllie2024-08-231-1/+15
| | | | |
| | | | * add amendendments for upload_dfs_to_dbEllie2024-08-231-13/+34
| | | | |
| | | | * add retrieve secrets functionEllie2024-08-231-1/+20
| | | | |
| | | | * add working completed tests for get transform bucketEllie2024-08-231-5/+13
| | | | |
| | | | * adds passing transform bucket testsEllie2024-08-231-11/+19
| | | | |
| | | | * add get transform bucket testEllie2024-08-232-5/+45
| | | | |
| | | | * add amendments to load lambdaEllie2024-08-231-29/+37
| | | | |
| | | | * add SQLalchemy to requirementsEllie2024-08-231-1/+2
| | | | |
| | | | * add testsEllie2024-08-232-5/+59
| | | | |
| | | | * add get transform bucket functionEllie2024-08-231-1/+15
| | | | |
| | | | * add improved convert parquet files to df functionEllie2024-08-231-14/+19
| | | | |
| | | | * add pyarrow to requirementsEllie2024-08-231-1/+2
| | | | |
| | | | * wip: add test file for load lambdaEllie2024-08-221-0/+9
| | | | |
git.ajschof.me — hosted by ajschofield — powered by cgit