Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weekly PR from Staging to Main #1040

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
70ac838
disable dependabot autoupdates for pip
nlebovits Nov 27, 2024
d0a7902
Merge pull request #1028 from CodeForPhilly/lebovits/issu1012-disable…
nlebovits Nov 27, 2024
021dd0e
update deps
nlebovits Nov 27, 2024
0666f1f
lint, format
nlebovits Nov 27, 2024
b51385f
add docstrings, typing; set num workers dynamically; minor tweaks to …
nlebovits Nov 27, 2024
f36f1d1
switch priority level calc to use z-score instead of percentile
nlebovits Nov 27, 2024
457099b
remove some logging
nlebovits Nov 28, 2024
f1d1c58
add draft database connection --no-verify
nlebovits Nov 28, 2024
0c37e21
restore deleted files from src/
nlebovits Dec 4, 2024
3cefa5d
Merge pull request #1036 from CodeForPhilly/lebovits/fix-src
nlebovits Dec 4, 2024
87538b4
commit working draft of hypertable creation (still needs to be cleane…
nlebovits Dec 4, 2024
f858b84
successfully posting to postgres w tsdb extension
nlebovits Dec 4, 2024
11231c6
get constituent tables set up as hypertables
nlebovits Dec 5, 2024
b8268c7
add month partitioning and compression policies to hypertables
nlebovits Dec 5, 2024
0b6f407
add slack reporter for hypertable sizes
nlebovits Dec 5, 2024
6496cf4
ruff
nlebovits Dec 5, 2024
dddca54
relocate dev deps in pipfile; reinstall
nlebovits Dec 8, 2024
54d78e1
fix issue with incorrect comment
nlebovits Dec 8, 2024
7c7fce2
remove outdated parquet write to GCS
nlebovits Dec 8, 2024
48bf627
restore post to GCP; data diff not yet working correctly
nlebovits Dec 9, 2024
b113fde
modularize large parts of featurelayer; add slack reporter for data QC
nlebovits Dec 9, 2024
8df4b56
create new draft of diff report for new timestamp approach
nlebovits Dec 9, 2024
dd998ed
modularize database, data loaders components of featurelayer.py
nlebovits Dec 9, 2024
36eb609
set up data diffing
nlebovits Dec 10, 2024
f566695
update pip deps
nlebovits Dec 10, 2024
5b436b7
get diff report working
nlebovits Dec 11, 2024
432cbb5
clean up logging; add try-except block if main.py fails
nlebovits Dec 11, 2024
0521199
track data_diff.py class
nlebovits Dec 11, 2024
928da95
re-add geoalchemy2 to pipfile
nlebovits Dec 11, 2024
6e82443
remove duplicate, outdated diff report file
nlebovits Dec 11, 2024
56fc5fb
Merge pull request #1037 from CodeForPhilly/lebovits/issu1015-cleanup…
nlebovits Dec 11, 2024
dad8003
Merge pull request #1051 from CodeForPhilly/main
CodeWritingCow Dec 12, 2024
ef58cb7
add 2025 roadmap
nlebovits Dec 17, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 13 additions & 13 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,16 +28,16 @@ updates:
patterns:
- '*'

- package-ecosystem: 'pip'
directory: '/data/src'
schedule:
interval: 'weekly'
target-branch: 'staging'
commit-message:
prefix: 'deps'
open-pull-requests-limit: 10
groups:
all-pip:
applies-to: version-updates
patterns:
- '*'
# - package-ecosystem: 'pip'
# directory: '/data/src'
# schedule:
# interval: 'weekly'
# target-branch: 'staging'
# commit-message:
# prefix: 'deps'
# open-pull-requests-limit: 10
# groups:
# all-pip:
# applies-to: version-updates
# patterns:
# - '*'
12 changes: 6 additions & 6 deletions data/src/Pipfile
Original file line number Diff line number Diff line change
Expand Up @@ -13,29 +13,29 @@ matplotlib = "*"
rasterio = "*"
scikit-learn = "*"
mapclassify = "*"
black = "*"
fiona = "*"
esridump = "*"
sqlalchemy = "*"
psycopg2-binary = "*"
geoalchemy2 = "*"
mapbox = "*"
google-cloud-storage = "*"
pydantic = "==2.8.2"
data-diff = {extras = ["postgresql"], version = "*"}
future = "*"
slack-sdk = "*"
pytest = "*"
networkx = "*"
libpysal = "*"
jenkspy = "*"
pyarrow = "*"
tqdm = "*"
geoalchemy2 ="*"

[dev-packages]
black = "*"
pytest = "*"
vulture = "*"
pylint = "*"
radon = "*"

[dev-packages]
ruff = "*"

[requires]
python_version = "3.11"
Expand Down
2,599 changes: 1,157 additions & 1,442 deletions data/src/Pipfile.lock

Large diffs are not rendered by default.

Loading
Loading