aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-234-180/+319
| | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
* Deleted the fact_table schema py fileslian-manonog2024-08-234-233/+157
| | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas
* dataframes combined into one fileT-Aji2024-08-231-0/+238
|
* Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-234-10/+62
|\ | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| * wip: wrote pseudocode for lambda handler in writing df to parquet file ↵lian-manonog2024-08-223-6/+56
| | | | | | | | format and uploading the parquet files
| * Refactored tests for transform lambda - all passing nowlian-manonog2024-08-221-4/+6
| |
* | payment schema addedT-Aji2024-08-232-2/+46
|/
* complete code for tables for purchase schema including a scrape for ↵Ang Bel2024-08-221-18/+48
| | | | currency table. Test to be done
* add fact tableT-Aji2024-08-221-50/+0
|
* Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-221-23/+30
|\ | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| * refactored approach to writing transformation as functions per df. WIPAng Bel2024-08-221-23/+30
| |
* | add fact tableT-Aji2024-08-221-4/+31
|/
* passing TestCreateDimCurrencyT-Aji2024-08-221-1/+18
|
* passing tests create_dim_design and create_dim_staffT-Aji2024-08-222-0/+90
|
* refactor df creation into funcT-Aji2024-08-221-70/+34
|
* wip: creating dim dataframesT-Aji2024-08-223-9/+58
|\
| * wip: fact_purchase_order schemalian-manonog2024-08-213-3/+37
| |
| * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-211-18/+68
| | | | | | | | | | | | This commit fixes the style issues introduced in 20a3bd8 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/85
* | began dim_date dfT-Aji2024-08-211-18/+17
|/
* Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-210-0/+0
|\ | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| * add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| |
| * ci: rm dev-test.ymlAlex2024-08-201-49/+0
| | | | | | It's in the wrong branch...
| * ci: update dev-test.ymlAlex2024-08-201-0/+1
| |
| * ci: add dev-test.ymlAlex2024-08-201-0/+48
| |
| * Merge pull request #80 from ajschofield/developmentAlex2024-08-201-0/+1
| |\ | | | | | | pr: github actions trigger deployment only if ref is main
* | | 5 dim tables createdT-Aji2024-08-211-15/+33
| | |
* | | add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | |
* | | ci: rm dev-test.ymlAlex2024-08-211-49/+0
| | | | | | | | | It's in the wrong branch...
* | | ci: update dev-test.ymlAlex2024-08-211-0/+1
| | |
* | | ci: add dev-test.ymlAlex2024-08-211-0/+48
| | |
* | | Merge pull request #84 from ajschofield/feature/transform_lambdabulve-ad2024-08-214-4/+120
|\ \ \ | | | | | | | | Feature/transform lambda read from s3 into df
| * \ \ Merge branch 'development' into feature/transform_lambdabulve-ad2024-08-2124-487/+676
| |\ \ \ | |/ / / |/| | |
* | | | Merge pull request #83 from ajschofield/ci/add-dev-tests-ymlAlex2024-08-201-0/+48
|\ \ \ \ | | | | | | | | | | pr: create dev-tests.yml
| * | | | ci: remove environment for dev-tests.ymlAlex2024-08-201-1/+0
| | | | |
| * | | | ci: create dev-tests.ymlAlex2024-08-201-0/+49
|/ / / /
* | | | Merge pull request #82 from ajschofield/test/test-branchAlex2024-08-201-2/+2
|\ \ \ \ | | | | | | | | | | test: test trigger for ci/cd
| * | | | test: test trigger for ci/cdAlex Schofield2024-08-201-2/+2
|/ / / /
* | | | Merge pull request #81 from ajschofield/alex/remove-dev-ga-workflowAlex2024-08-201-43/+0
|\ \ \ \ | |_|_|/ |/| | | chore: rm workflow file from development
| * | | chore: rm workflow file from developmentAlex2024-08-201-43/+0
|/ / /
* | | Merge pull request #79 from ajschofield/ci/actions-triggerAlex2024-08-201-0/+1
|\ \ \ | | | | | | | | pr: update deploy.yml
| * | | ci: update deploy.ymlAlex2024-08-201-0/+1
|/ / /
* | | Merge pull request #78 from ajschofield/mainAlex2024-08-201-0/+3
|\ \ \ | | |/ | |/| pr: merge lambda timeout hotfix into development
| * | Merge pull request #77 from ajschofield/alex/lambda-timeoutAlex2024-08-201-0/+3
| |\ \ | | | | | | | | hotfix: increase lambda timeout
| | * \ Merge branch 'main' into alex/lambda-timeoutAlex2024-08-200-0/+0
| | |\ \ | | |/ / | |/| |
| * | | Merge pull request #76 from ajschofield/developmentAlex2024-08-2021-101/+1363
| |\ \ \ | |/ / / |/| | | pr: pull development into main
| | * | hotfix: increase lambda timeoutAlex Schofield2024-08-201-0/+3
| |/ / |/| |
* | | Merge pull request #75 from ajschofield/alex/repo-tidy-upAlex2024-08-203-129/+0
|\ \ \ | | | | | | | | pr: tidy-up repository & remove unused files
| * | | chore: tidy-up repository & remove unused filesAlex Schofield2024-08-203-129/+0
|/ / /
* | | Merge pull request #74 from ajschofield/alex/tf-lambda-changesAlex2024-08-202-5/+11
|\ \ \ | | | | | | | | pr: fix extract_lambda execution & policy doc
| * | | infra(tf): add ListBucket and GetObject permissionsAlex Schofield2024-08-201-3/+6
| | | |
git.ajschof.me — hosted by ajschofield — powered by cgit