Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#20 and some vulnerabilities resolved #47

Merged
merged 34 commits into from
Oct 24, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
3b70972
Added a running check possibility and changed documentation
DaBeIDS Oct 22, 2023
56b0d90
Changed initial README
DaBeIDS Oct 22, 2023
572f3b7
Merge branch 'feature/2023-10_issue_32' of https://github.com/DaBeIDS…
DaBeIDS Oct 22, 2023
dad4e52
Merge pull request #1 from DaBeIDS/feature/2023-10_issue_32
DaBeIDS Oct 22, 2023
d62e23a
Small change in Readme on top
DaBeIDS Oct 22, 2023
177cd26
Merge branch 'os-climate:main' into main
DaBeIDS Oct 22, 2023
a5b6883
Changed Pytorch Docker Image
DaBeIDS Oct 22, 2023
0ac39bc
Feature/2023.07 os test refactor test cases (#21)
tobias-watzel Sep 1, 2023
a838695
Feature/2023.04 os test (#22)
DaBeIDS Sep 1, 2023
5317926
Added a first version of the manual and upgraded pdfminer to also loa…
DaBeIDS Sep 7, 2023
4d39031
Added .idea to gitignore and deleted folder
DaBeIDS Sep 7, 2023
6adb710
Update requirements.txt
DaBeIDS Sep 7, 2023
31c9976
Update requirements.txt
DaBeIDS Sep 7, 2023
ed4f82d
Update requirements.txt
DaBeIDS Sep 7, 2023
1901c5d
Update requirements.txt
DaBeIDS Sep 7, 2023
44d1a08
Manual and helping jupyter notebook added
DaBeIDS Sep 8, 2023
bccfbd1
Take out Pycharm part
DaBeIDS Sep 8, 2023
da43c2b
Updated the documentation to a new structure.
DaBeIDS Sep 15, 2023
b58440d
Small changes in documentation
DaBeIDS Sep 18, 2023
0b5af5e
Added a running check possibility and changed documentation
DaBeIDS Oct 22, 2023
2a21216
Changed initial README
DaBeIDS Oct 22, 2023
5f2c446
updated RB rules to enable more KPIs for non-cdp reports (#36)
idemir-ids Oct 19, 2023
7274859
Small change in Readme on top
DaBeIDS Oct 22, 2023
0ebb269
bugfix: uncommented not yet implemented KPI rule
idemir-ids Oct 20, 2023
ab8935e
Small Typo
DaBeIDS Oct 22, 2023
7452959
Merge branch 'os-climate:main' into feature/2023-10_issue_20
DaBeIDS Oct 22, 2023
8c61f92
Update requirements.txt
DaBeIDS Oct 23, 2023
133b2ce
Update requirements.txt
DaBeIDS Oct 23, 2023
25cb28b
Update requirements.txt
DaBeIDS Oct 23, 2023
92c396b
Update requirements.txt
DaBeIDS Oct 23, 2023
dc62310
Update requirements.txt
DaBeIDS Oct 23, 2023
ba497e6
Merged requirements.txt
DaBeIDS Oct 23, 2023
4966d60
Merge pull request #4 from DaBeIDS/feature/2023-10_issue_20
DaBeIDS Oct 24, 2023
8949d1d
Merge branch 'os-climate:main' into main
DaBeIDS Oct 24, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion data_extractor/code/infer_on_pdf.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
import argparse
import requests
import os
import config_path
import utils.config_path as config_path
import json
import yaml
import csv
Expand Down

This file was deleted.

13 changes: 5 additions & 8 deletions data_extractor/code/model_pipeline/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
ARG PYTORCH="1.6.0"
ARG CUDA="10.1"
ARG CUDNN="7"
ARG PYTORCH="1.11.0"
ARG CUDA="11.3"
ARG CUDNN="8"

FROM pytorch/pytorch:${PYTORCH}-cuda${CUDA}-cudnn${CUDNN}-devel
ENV TORCH_CUDA_ARCH_LIST="3.7 6.0 6.1 7.0+PTX"
Expand All @@ -9,10 +9,10 @@ RUN mkdir -p /.cache
RUN chmod -R 777 /.cache

RUN apt-key del 3bf863cc
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/3bf863cc.pub
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/3bf863cc.pub

RUN apt-key del 7fa2af80
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64/7fa2af80.pub
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu2004/x86_64/7fa2af80.pub

RUN apt-get update
RUN apt-get install -y unzip vim git wget
Expand All @@ -26,9 +26,6 @@ RUN chmod -R 777 /app/code

ENV SKLEARN_ALLOW_DEPRECATED_SKLEARN_PACKAGE_INSTALL=True

WORKDIR /app/code/kpi_inference_data_pipeline
RUN pip install -e .

WORKDIR /app/code/model_pipeline
RUN pip install -e .

Expand Down
35 changes: 17 additions & 18 deletions data_extractor/code/model_pipeline/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,19 +1,18 @@
traitlets==5.4
requests==2.26.0
jinja2==3.0
ipython==7.23.1
urllib3==1.26.7
gdown==3.11.1
tqdm==4.48.0
xlrd==1.2.0
traitlets
requests
gdown
tqdm
xlrd
pandas==1.0.5
farm==0.5.0
optuna==2.0.0
Werkzeug==2.2.2
Flask==2.2.5
pyspellchecker==0.5.5
spacy==2.3.2
MarkupSafe==2.0.1
boto3==1.18.15
scikit-learn==0.24.1
protobuf==3.20.0
farm
optuna
Werkzeug==0.16.1
Flask==1.1.4
pyspellchecker
spacy
MarkupSafe
boto3
scikit-learn
protobuf
fuzzywuzzy
python-Levenshtein
Loading