-
-
Notifications
You must be signed in to change notification settings - Fork 242
[ENH] V1 -> V2 Migration - Flows (module) #1609
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
Omswastik-11
wants to merge
232
commits into
openml:main
Choose a base branch
from
Omswastik-11:flow-migration-stacked
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
232 commits
Select commit
Hold shift + click to select a range
bf6e000
changes made
satvshr 0159f47
set up folder structure and base code
geetu040 8b6af81
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
satvshr 834782c
bug fixing
satvshr 38ae9be
test failures fix
satvshr 93ab9c2
Update flow_id_tutorial.py
satvshr aa25dd6
_defaults bug fixing
satvshr 58e9175
Merge branch 'main' into migration
fkiraly a98b6b1
removed __setattr__ given it is not supported
satvshr 7c82054
Merge branch 'main' into issue1564
satvshr bdd65ff
Merge branch 'main' into migration
geetu040 f8fbe1e
Merge branch 'main' into issue1564
satvshr 4fdcb64
Merge branch 'main' into issue1564
satvshr b3513f0
Merge branch 'main' into issue1564
satvshr 52ef379
fix pre-commit
geetu040 146dd21
Update all files
satvshr 7a67bf0
Update introduction_tutorial.py
satvshr 5dfcbce
refactor
geetu040 2acbe99
implement cache_dir
geetu040 af99880
refactor
geetu040 b111905
Merge branch 'main' into pr/1577
fkiraly 83f36c2
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
fkiraly 74ab366
Merge branch 'main' into pr/1576
fkiraly 561b204
migrate flow module
Omswastik-11 860b1b6
implement FlowsV2.exists() and get() with JSON parsing
Omswastik-11 36c22aa
skip delete flows tests
Omswastik-11 4241624
bug fixing
satvshr f01c1e9
Update test_utils.py
satvshr 07cc1c8
Update test_config.py
satvshr 1dbc780
merge main
satvshr 36184e5
remove chaching part
Omswastik-11 371ae4a
Merge branch 'main' into flow-migration-stacked
Omswastik-11 862b463
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 4c75e16
undo changes in tasks/functions.py
geetu040 5762185
Merge branch 'main' into migration
geetu040 b2dcdf2
Merge branch 'main' into flow-migration-stacked
Omswastik-11 021a1e1
made requested changes
satvshr 4c4a12c
Merge branch 'main' into issue1564
satvshr 1d91220
made requested changes
satvshr 3e26ace
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
satvshr 0060b2e
fixed bugs
satvshr 65ba66b
fixed bugs
satvshr 317c6e9
fixed bugs
satvshr 503ab82
fixed bugs
satvshr 2aa1b36
Merge branch 'main' into flow-migration-stacked
Omswastik-11 fd7ea2b
Merge branch 'main' into issue1564
satvshr fa3cd40
bug fixing
satvshr 7e9bc1f
Merge branch 'main' into migration
geetu040 c603383
add tests directory
geetu040 ff6a8b0
use enum for delay method
geetu040 f01898f
implement cache
geetu040 5c4511e
refactor clients
geetu040 29fac2c
migrating v1 -> v2 flows
Omswastik-11 bdf53f3
migrating v1 -> v2 flows
Omswastik-11 9d0098f
Merge branch 'main' into issue1564
fkiraly a1a706c
Merge branch 'main' into flow-migration-stacked
Omswastik-11 43276d2
fix import in resources/base.py
geetu040 1206f69
refactor and add exception handling
geetu040 bde5942
Merge branch 'main' into issue1564
satvshr 4948e99
refactor resources/base/
geetu040 a354167
implement delete
geetu040 c4e713f
Merge remote-tracking branch 'geetu040/migration' into flow-migration…
Omswastik-11 95fc75f
Merge branch 'main' into flow-migration-stacked
Omswastik-11 1fe7e3e
implement publish and minor refactoring
geetu040 54a3151
implement tag/untag
geetu040 2b6fe65
implement fallback
geetu040 685c19a
added tests
Omswastik-11 920ff21
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 fa53f8d
add test_http.py
geetu040 2b2db96
add uses_test_server marker
geetu040 c7c24a3
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 c9617f9
implement reset_cache
geetu040 92d88e4
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 443ade9
tests:added tests for migration
Omswastik-11 468087d
tests:added tests for migration
Omswastik-11 5bc37b8
fixes with publish/delete
geetu040 08d9916
fix cache_key in tests
geetu040 9660e78
tests:added tests for migration
Omswastik-11 f60c78b
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 f25c95b
tests:added tests for migration
Omswastik-11 8caba11
update _not_supported
geetu040 6e577c4
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 1913c10
add 'get_api_config' skeleton method
SimonBlanke 7681949
remove 'APISettings'
SimonBlanke 01840a5
impl. 'get_api_config'
SimonBlanke 26ed4c1
add singleton pattern for settings
SimonBlanke c588d0c
add 'reset_settings'
SimonBlanke b6ff720
remove unused code
SimonBlanke 80d5afc
reimplement usage of v1 settings config
SimonBlanke f47112c
first try v2, fallback to v1 if not available
SimonBlanke d44cf3e
reimplement singelton without the use of 'global'
SimonBlanke ea7dda1
add explanations
SimonBlanke f0e5947
change usage of settings to new impl.
SimonBlanke edcd006
add explanations
SimonBlanke cde0aae
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] edc5772
added tag and untag methods
Omswastik-11 aa1e560
move to config: APIVersion, ResourceType
geetu040 06b8497
remove api_context entirely
geetu040 384da91
major refactor
geetu040 1878138
more refactoring with setup/
geetu040 dc26e01
implement APIBackend as controller
geetu040 e2d059b
move enums
geetu040 d156ad4
module level imports
geetu040 d7a3788
module level import for _backend
geetu040 b5b9ef6
module level import for tests
geetu040 68820fe
Merge branch 'main' into migration
geetu040 567eca4
add test: test_tag_and_untag
geetu040 a82a636
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 d39d9d0
Apply suggestion from @geetu040
Omswastik-11 724c4ae
add suggestion
Omswastik-11 0251f49
change test_publish_error to use test server
Omswastik-11 e213873
changed test_publish_error to use test server
Omswastik-11 b6f38cd
changed test_list_flows_empty to use test_server instead
Omswastik-11 e06c538
move flow migration test to test_api dir
Omswastik-11 fccb772
remove old caching used by get_flow
Omswastik-11 3d61b27
increase timout time
Omswastik-11 b2287c3
implement get/set_config_values
geetu040 b7e285e
improve APIBackend.set_config_values
geetu040 fd43c48
use LegacyConfig
geetu040 f4aab6b
Revert "use LegacyConfig"
geetu040 d43cf86
implement _sync_api_config
geetu040 3e323ed
update tests with _sync_api_config
geetu040 9195fa6
rename config: timeout -> timeout_seconds
geetu040 5342eec
use timedelta for default ttl value
geetu040 adc0e74
update tests, adds v2/fallback
geetu040 bfb2d3e
add MinIOClient in TestBase
geetu040 cabaecf
fix linting for builder
geetu040 d1da932
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 671f077
correct the list method
Omswastik-11 85c1113
fix unbound variables: "code", "message"
geetu040 39bf86a
use requests.Session()
geetu040 7b66677
remove "timeout_seconds" entirely
geetu040 d2224c4
update/refactor tests
geetu040 9608c36
remove unused current_api_version from TestAPIBase
geetu040 f6bc7f7
make TestAPIBase inherit TestBase
geetu040 baa3a38
nits: test classes
geetu040 c9e4b73
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 acfa2bb
correct the tests
Omswastik-11 63fa0a0
correct the tests
Omswastik-11 aa9d486
correct the tests
Omswastik-11 8802b8a
correct the tests
Omswastik-11 52b93fe
minor fix in _sync_api_config
geetu040 ec9477f
chore: rerun CI
geetu040 0c480da
replace old delete method tests
Omswastik-11 c7d9fe5
correct the tests
Omswastik-11 935b64e
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 b273193
correct the tests
Omswastik-11 911f44d
correct the tests
Omswastik-11 10d134a
remove duplicates in _api/resources/__init__.py
geetu040 935f0f4
implement HTTPClient.download and add tests
geetu040 9514df8
add docstrings
geetu040 53bee94
update minio
geetu040 0e05a16
merge
Omswastik-11 7413191
correct the tests
Omswastik-11 33b4ca0
make delay functions static
geetu040 a6b9a45
rename: retry_raise_e -> exception
geetu040 f924b32
use context-manager for requests.Session
geetu040 541b0f2
remove "assert response is not None"
geetu040 acb173f
verify checksum before caching
geetu040 3e8d1f0
update tests
geetu040 f83bdb5
minor fix in ResourceV1API.untag
geetu040 2a42712
remove cache.ttl
geetu040 001caad
replace config.cache.dir with config.cache_dir
geetu040 fb38a2d
make HTTPClient.cache compulsory
geetu040 03c4ca9
remove unused OpenMLCacheRequiredError
geetu040 8d708fd
implement and use TestAPIBase._create_resource
geetu040 4f75bba
make ResourceAPI.minio compulsory
geetu040 164f66f
Merge branch 'main' into migration
geetu040 c4dae43
rename: use_cache -> enable_cache; reset_cache -> refresh_cache
geetu040 36c20a2
use server config from TestBase
geetu040 ab3c1eb
tests: mock HTTP post calls to prevent race conditions
geetu040 ff0220e
modify the flow to use latest caching
Omswastik-11 f8144e2
Merge branch 'main' into flow-migration-stacked
Omswastik-11 2a488ca
Merge branch 'main' into migration
geetu040 599c7e1
remove hardcoded server in TestHTTPClient.test_cache
geetu040 2867862
fix docstring in _resolve_default_cache_dir
geetu040 f09f3cd
fix docstring in ResourceAPI
geetu040 5f731ce
remove duplicates in __all__
geetu040 bad7842
remove ttl related code/docs
geetu040 aefdb38
remove delay methods in HTTPClient
geetu040 0f40b02
minor fix in _resolve_default_cache_dir
geetu040 7ac1672
update FallbackProxy
geetu040 6ac1dfe
simplify _backend creation
geetu040 62924c9
Merge branch 'main' into migration
geetu040 27696bb
req changes
satvshr 190face
resolve conflicts
satvshr 95daaa6
remove old config file
satvshr 7841ea8
added OPENML_TEST_SERVER_ADMIN_KEY_ENV_VAR
satvshr cc515aa
bug fixing
satvshr e6a92df
armagh fix
satvshr 1b8c22a
update content_type check
geetu040 fc839a6
Revert "make delay functions static"
geetu040 1c922af
Revert "remove delay methods in HTTPClient"
geetu040 ffa9ce9
Merge branch 'main' into migration
geetu040 a7b2d21
allow api_key=None
geetu040 27fe790
add tests for api_key=None
geetu040 8965112
update cache not found message
geetu040 72ea1a4
update docs for path in HTTPCache
geetu040 a696c49
remove elapsed from cached meta
geetu040 755636d
move self.headers to _HEADERS
geetu040 d07af34
fix indentation in docstrings of _resolve_default_cache_dir
geetu040 2d9c8ec
Update openml/_api/clients/http.py
geetu040 002b989
Merge branch 'main' into migration
geetu040 045d896
move _handle_delete_exception and_get_endpoint_name, legal_resources
geetu040 c437966
set HTTPClient.headers
geetu040 e27470a
remove main_tag
geetu040 d04d956
remove and merge TestAPIBase into TestBase
geetu040 9263f7f
minor change in TestHTTPClient.test_cache
geetu040 79dea29
make HTTPClient.request private
geetu040 f6497c2
Revert "update FallbackProxy"
geetu040 dce7f54
use st_ctime instead of st_ctime for cache refresh test
geetu040 40dd460
Merge branch 'main' into issue1564
geetu040 0fc917c
majore config refactor
geetu040 3d86b18
Merge branch 'pr-1577' into migration
geetu040 aba3d3e
update _config.py
geetu040 d99d54d
update test_openml_cache_dir_env_var
geetu040 dc22e3a
fix mutable SERVERS_REGISTRY
geetu040 7318573
update set_api_version for fallback
geetu040 29ef187
minor fix
geetu040 cf94c89
fixes for test_config
geetu040 298fbda
fixes in conftest urls
geetu040 9870502
update test_http.py
geetu040 33065c2
undo changes with test_openml_cache_dir_env_var
geetu040 76b92bb
fix server mode in test_config.py
geetu040 419edcb
move _HEADERS to confing
geetu040 cb6d937
add fixtures for migration tests
geetu040 8544c8a
update test_http.py with fixtures
geetu040 d4c413b
update test_versions.py
geetu040 fab1a15
update test_versions.py
geetu040 4e75b92
merge
Omswastik-11 49c6d59
modify the tests
Omswastik-11 af9f5e6
Merge branch 'flow-migration-stacked' of https://github.com/Omswastik…
Omswastik-11 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,85 @@ | ||
| from .clients import ( | ||
| HTTPCache, | ||
| HTTPClient, | ||
| MinIOClient, | ||
| ) | ||
| from .resources import ( | ||
| API_REGISTRY, | ||
| DatasetAPI, | ||
| DatasetV1API, | ||
| DatasetV2API, | ||
| EstimationProcedureAPI, | ||
| EstimationProcedureV1API, | ||
| EstimationProcedureV2API, | ||
| EvaluationAPI, | ||
| EvaluationMeasureAPI, | ||
| EvaluationMeasureV1API, | ||
| EvaluationMeasureV2API, | ||
| EvaluationV1API, | ||
| EvaluationV2API, | ||
| FallbackProxy, | ||
| FlowAPI, | ||
| FlowV1API, | ||
| FlowV2API, | ||
| ResourceAPI, | ||
| ResourceV1API, | ||
| ResourceV2API, | ||
| RunAPI, | ||
| RunV1API, | ||
| RunV2API, | ||
| SetupAPI, | ||
| SetupV1API, | ||
| SetupV2API, | ||
| StudyAPI, | ||
| StudyV1API, | ||
| StudyV2API, | ||
| TaskAPI, | ||
| TaskV1API, | ||
| TaskV2API, | ||
| ) | ||
| from .setup import ( | ||
| APIBackend, | ||
| APIBackendBuilder, | ||
| _backend, | ||
| ) | ||
|
|
||
| __all__ = [ | ||
| "API_REGISTRY", | ||
| "APIBackend", | ||
| "APIBackendBuilder", | ||
| "DatasetAPI", | ||
| "DatasetV1API", | ||
| "DatasetV2API", | ||
| "EstimationProcedureAPI", | ||
| "EstimationProcedureV1API", | ||
| "EstimationProcedureV2API", | ||
| "EvaluationAPI", | ||
| "EvaluationMeasureAPI", | ||
| "EvaluationMeasureV1API", | ||
| "EvaluationMeasureV2API", | ||
| "EvaluationV1API", | ||
| "EvaluationV2API", | ||
| "FallbackProxy", | ||
| "FlowAPI", | ||
| "FlowV1API", | ||
| "FlowV2API", | ||
| "HTTPCache", | ||
| "HTTPClient", | ||
| "MinIOClient", | ||
| "ResourceAPI", | ||
| "ResourceV1API", | ||
| "ResourceV2API", | ||
| "RunAPI", | ||
| "RunV1API", | ||
| "RunV2API", | ||
| "SetupAPI", | ||
| "SetupV1API", | ||
| "SetupV2API", | ||
| "StudyAPI", | ||
| "StudyV1API", | ||
| "StudyV2API", | ||
| "TaskAPI", | ||
| "TaskV1API", | ||
| "TaskV2API", | ||
| "_backend", | ||
| ] | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| from .http import HTTPCache, HTTPClient | ||
| from .minio import MinIOClient | ||
|
|
||
| __all__ = [ | ||
| "HTTPCache", | ||
| "HTTPClient", | ||
| "MinIOClient", | ||
| ] |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
__all__contains duplicate entries (e.g.,FallbackProxyandResourceAPIare listed twice). This is harmless at runtime but makes exports harder to reason about; please deduplicate the list.