aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'development' into feature/load-lambdaEllie2024-08-275-13/+733
|\
| * Merge pull request #97 from ajschofield/test/test_transform_lambdalian-manonog2024-08-274-150/+270
| |\ | | | | | | PR: mergeing test_transform_lambda to dev
| | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-273-59/+65
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in c68f63f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/97
| | * wip: refactored fact payment functionlian-manonog2024-08-272-8/+9
| | |
| | * wip: added a bracket in dataframeslian-manonog2024-08-272-3/+4
| | |
| | * Merge pull request #96 from ajschofield/test/dataframesbulve-ad2024-08-232-169/+233
| | |\ | | | | | | | | pr: combining tests for transform lambda
| | | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-38/+41
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8f75a47 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96
| | | * Merge branch 'test/test_transform_lambda' into test/dataframesbulve-ad2024-08-2311-283/+340
| | | |\ | | | |/ | | |/|
| | * | wip: writing more tests for the helper functionslian-manonog2024-08-231-2/+12
| | | |
| | * | wip: pushing againlian-manonog2024-08-233-9/+47
| |/ /
| * | Merge pull request #94 from ajschofield/feature/transform-fact-sales-orderlian-manonog2024-08-235-10/+611
| |\ \ | | | | | | | | PR: rebased the fact-sales branch with the datafrrames branch - now merging into development
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-231-4/+3
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 88f1ef7 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/94
| | * | Removed redundant empty lines of codelian-manonog2024-08-231-4/+0
| | | |
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-10/+15
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 3ff2182 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
| | * | trying to resolce git index issue conflicts - commiting was the only solutionlian-manonog2024-08-232-9/+8
| | | |
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-234-180/+319
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
| | * | Deleted the fact_table schema py fileslian-manonog2024-08-234-233/+157
| | | | | | | | | | | | | | | | | | | | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas
| | | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-155/+330
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 821e241 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96
| | | * tests: additional tests written (pass) for dim tables transformation. Fact ↵Ang Bel2024-08-232-61/+82
| | | | | | | | | | | | | | | | transformation functions not yet tested
| | | * fix: refactoring for create_dim_date to include all date columns from all ↵Ang Bel2024-08-231-20/+13
| | | | | | | | | | | | | | | | fact dfs, tested on dummy data. Tests are not written
| | | * removed duplicate functionsT-Aji2024-08-231-16/+69
| | | |
| | | * removed duplicate functionsT-Aji2024-08-231-89/+28
| | |/
| | * dataframes combined into one fileT-Aji2024-08-231-0/+238
| | |
| | * Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-234-10/+62
| | |\ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | | * wip: wrote pseudocode for lambda handler in writing df to parquet file ↵lian-manonog2024-08-223-6/+56
| | | | | | | | | | | | | | | | format and uploading the parquet files
| | | * Refactored tests for transform lambda - all passing nowlian-manonog2024-08-221-4/+6
| | | |
| | * | payment schema addedT-Aji2024-08-232-2/+46
| | |/
| | * complete code for tables for purchase schema including a scrape for ↵Ang Bel2024-08-221-18/+48
| | | | | | | | | | | | currency table. Test to be done
| | * add fact tableT-Aji2024-08-221-50/+0
| | |
| | * Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-221-23/+30
| | |\ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | | * refactored approach to writing transformation as functions per df. WIPAng Bel2024-08-221-23/+30
| | | |
| | * | add fact tableT-Aji2024-08-221-4/+31
| | |/
| | * passing TestCreateDimCurrencyT-Aji2024-08-221-1/+18
| | |
| | * passing tests create_dim_design and create_dim_staffT-Aji2024-08-222-0/+90
| | |
| | * refactor df creation into funcT-Aji2024-08-221-70/+34
| | |
| | * wip: creating dim dataframesT-Aji2024-08-223-9/+58
| | |\
| | | * wip: fact_purchase_order schemalian-manonog2024-08-213-3/+37
| | | |
| | | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-211-18/+68
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 20a3bd8 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/85
| | * | began dim_date dfT-Aji2024-08-211-18/+17
| | |/
| | * Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-210-0/+0
| | |\ | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| | | * add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | | |
| | | * ci: rm dev-test.ymlAlex2024-08-201-49/+0
| | | | | | | | | | | | It's in the wrong branch...
| | | * ci: update dev-test.ymlAlex2024-08-201-0/+1
| | | |
| | | * ci: add dev-test.ymlAlex2024-08-201-0/+48
| | | |
| | | * Merge pull request #80 from ajschofield/developmentAlex2024-08-201-0/+1
| | | |\ | | | | | | | | | | pr: github actions trigger deployment only if ref is main
| | * | | 5 dim tables createdT-Aji2024-08-211-15/+33
| | | | |
| | * | | add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | | | |
| | * | | ci: rm dev-test.ymlAlex2024-08-211-49/+0
| | | | | | | | | | | | | | | It's in the wrong branch...
| | * | | ci: update dev-test.ymlAlex2024-08-211-0/+1
| | | | |
| | * | | ci: add dev-test.ymlAlex2024-08-211-0/+48
| | | | |
git.ajschof.me — hosted by ajschofield — powered by cgit