-
-
Notifications
You must be signed in to change notification settings - Fork 243
[ENH] V1 -> V2 Migration : Runs #1616
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
Omswastik-11
wants to merge
225
commits into
openml:main
Choose a base branch
from
Omswastik-11:runs-migration-stacked
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+3,947
−643
Open
Changes from all commits
Commits
Show all changes
225 commits
Select commit
Hold shift + click to select a range
bf6e000
changes made
satvshr 0159f47
set up folder structure and base code
geetu040 8b6af81
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
satvshr 834782c
bug fixing
satvshr 38ae9be
test failures fix
satvshr 93ab9c2
Update flow_id_tutorial.py
satvshr aa25dd6
_defaults bug fixing
satvshr 58e9175
Merge branch 'main' into migration
fkiraly a98b6b1
removed __setattr__ given it is not supported
satvshr 7c82054
Merge branch 'main' into issue1564
satvshr bdd65ff
Merge branch 'main' into migration
geetu040 f8fbe1e
Merge branch 'main' into issue1564
satvshr 4fdcb64
Merge branch 'main' into issue1564
satvshr b3513f0
Merge branch 'main' into issue1564
satvshr 52ef379
fix pre-commit
geetu040 146dd21
Update all files
satvshr 7a67bf0
Update introduction_tutorial.py
satvshr 5dfcbce
refactor
geetu040 2acbe99
implement cache_dir
geetu040 af99880
refactor
geetu040 b111905
Merge branch 'main' into pr/1577
fkiraly 83f36c2
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
fkiraly 74ab366
Merge branch 'main' into pr/1576
fkiraly 4241624
bug fixing
satvshr f01c1e9
Update test_utils.py
satvshr 07cc1c8
Update test_config.py
satvshr 1dbc780
merge main
satvshr 3c61c5e
Merge branch 'main' into runs-migration-stacked
Omswastik-11 b284a0a
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 4c75e16
undo changes in tasks/functions.py
geetu040 5762185
Merge branch 'main' into migration
geetu040 3da4760
revert the tarsks/function changes
Omswastik-11 021a1e1
made requested changes
satvshr 4c4a12c
Merge branch 'main' into issue1564
satvshr 1d91220
made requested changes
satvshr 3e26ace
Merge branch 'issue1564' of https://github.com/satvshr/openml-python …
satvshr 0060b2e
fixed bugs
satvshr 65ba66b
fixed bugs
satvshr 317c6e9
fixed bugs
satvshr 503ab82
fixed bugs
satvshr e5b7af4
Merge branch 'main' into runs-migration-stacked
Omswastik-11 fd7ea2b
Merge branch 'main' into issue1564
satvshr fa3cd40
bug fixing
satvshr 716667c
migrating v1 -> v2 runs
Omswastik-11 68a403a
Merge branch 'runs-migration-stacked' of https://github.com/Omswastik…
Omswastik-11 7e9bc1f
Merge branch 'main' into migration
geetu040 c603383
add tests directory
geetu040 ff6a8b0
use enum for delay method
geetu040 f01898f
implement cache
geetu040 5c4511e
refactor clients
geetu040 9d0098f
Merge branch 'main' into issue1564
fkiraly 43276d2
fix import in resources/base.py
geetu040 1206f69
refactor and add exception handling
geetu040 bde5942
Merge branch 'main' into issue1564
satvshr 4948e99
refactor resources/base/
geetu040 a354167
implement delete
geetu040 1fe7e3e
implement publish and minor refactoring
geetu040 54a3151
implement tag/untag
geetu040 2b6fe65
implement fallback
geetu040 29fd985
Merge branches 'migration' and 'migration' of https://github.com/geet…
Omswastik-11 fa53f8d
add test_http.py
geetu040 2b2db96
add uses_test_server marker
geetu040 0135ba2
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 c9617f9
implement reset_cache
geetu040 5bc37b8
fixes with publish/delete
geetu040 08d9916
fix cache_key in tests
geetu040 37a468f
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 8caba11
update _not_supported
geetu040 a70a33f
tests:added tests for migration
Omswastik-11 d08b1fe
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 aaf9d4b
tests:added tests for migration
Omswastik-11 84d43a9
Merge branch 'main' into runs-migration-stacked
Omswastik-11 761ef9e
tests:modified old chache tests to use new caching
Omswastik-11 cf37a75
Merge branch 'runs-migration-stacked' of https://github.com/Omswastik…
Omswastik-11 2eb7c7a
tests:modified old chache tests to use new caching
Omswastik-11 d9476c8
tests:modified old chache tests to use new caching
Omswastik-11 f4718c1
tests:skip the production related tests
Omswastik-11 4560b6b
tests:modify skip messgaes
Omswastik-11 1913c10
add 'get_api_config' skeleton method
SimonBlanke 7681949
remove 'APISettings'
SimonBlanke 01840a5
impl. 'get_api_config'
SimonBlanke 26ed4c1
add singleton pattern for settings
SimonBlanke c588d0c
add 'reset_settings'
SimonBlanke b6ff720
remove unused code
SimonBlanke 80d5afc
reimplement usage of v1 settings config
SimonBlanke f47112c
first try v2, fallback to v1 if not available
SimonBlanke d44cf3e
reimplement singelton without the use of 'global'
SimonBlanke ea7dda1
add explanations
SimonBlanke f0e5947
change usage of settings to new impl.
SimonBlanke edcd006
add explanations
SimonBlanke cde0aae
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 48fa391
modify get method to use use_chache by default
Omswastik-11 aa1e560
move to config: APIVersion, ResourceType
geetu040 06b8497
remove api_context entirely
geetu040 384da91
major refactor
geetu040 1878138
more refactoring with setup/
geetu040 dc26e01
implement APIBackend as controller
geetu040 e2d059b
move enums
geetu040 d156ad4
module level imports
geetu040 d7a3788
module level import for _backend
geetu040 b5b9ef6
module level import for tests
geetu040 68820fe
Merge branch 'main' into migration
geetu040 567eca4
add test: test_tag_and_untag
geetu040 ff33d8e
move runs to run with better class name
Omswastik-11 20ee072
changed test to use latest backed style
Omswastik-11 0a7dd16
move runs test to test_api dir
Omswastik-11 b2287c3
implement get/set_config_values
geetu040 b7e285e
improve APIBackend.set_config_values
geetu040 fd43c48
use LegacyConfig
geetu040 f4aab6b
Revert "use LegacyConfig"
geetu040 d43cf86
implement _sync_api_config
geetu040 3e323ed
update tests with _sync_api_config
geetu040 9195fa6
rename config: timeout -> timeout_seconds
geetu040 5342eec
use timedelta for default ttl value
geetu040 adc0e74
update tests, adds v2/fallback
geetu040 bfb2d3e
add MinIOClient in TestBase
geetu040 cabaecf
fix linting for builder
geetu040 e14532f
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 a64203d
add run migrtation test file
Omswastik-11 85c1113
fix unbound variables: "code", "message"
geetu040 39bf86a
use requests.Session()
geetu040 7b66677
remove "timeout_seconds" entirely
geetu040 d2224c4
update/refactor tests
geetu040 c6351e0
correct the not implemented error
Omswastik-11 9608c36
remove unused current_api_version from TestAPIBase
geetu040 f6bc7f7
make TestAPIBase inherit TestBase
geetu040 baa3a38
nits: test classes
geetu040 d6146aa
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 b349581
remove old caching tests
Omswastik-11 52b93fe
minor fix in _sync_api_config
geetu040 ec9477f
chore: rerun CI
geetu040 ad05cd3
remove old delete methods
Omswastik-11 5cdc0ad
correct the url
Omswastik-11 7457f16
correct the tests
Omswastik-11 f199479
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 282c7d9
correct the tests
Omswastik-11 10d134a
remove duplicates in _api/resources/__init__.py
geetu040 935f0f4
implement HTTPClient.download and add tests
geetu040 9514df8
add docstrings
geetu040 53bee94
update minio
geetu040 4f8c9b3
correct the tests
Omswastik-11 7f98c61
merge
Omswastik-11 33b4ca0
make delay functions static
geetu040 a6b9a45
rename: retry_raise_e -> exception
geetu040 f924b32
use context-manager for requests.Session
geetu040 541b0f2
remove "assert response is not None"
geetu040 acb173f
verify checksum before caching
geetu040 3e8d1f0
update tests
geetu040 f83bdb5
minor fix in ResourceV1API.untag
geetu040 2a42712
remove cache.ttl
geetu040 001caad
replace config.cache.dir with config.cache_dir
geetu040 fb38a2d
make HTTPClient.cache compulsory
geetu040 03c4ca9
remove unused OpenMLCacheRequiredError
geetu040 8d708fd
implement and use TestAPIBase._create_resource
geetu040 4f75bba
make ResourceAPI.minio compulsory
geetu040 164f66f
Merge branch 'main' into migration
geetu040 c4dae43
rename: use_cache -> enable_cache; reset_cache -> refresh_cache
geetu040 36c20a2
use server config from TestBase
geetu040 ab3c1eb
tests: mock HTTP post calls to prevent race conditions
geetu040 0577e45
Merge branch 'main' into runs-migration-stacked
Omswastik-11 d4965eb
merge
Omswastik-11 ea3a8ae
merge
Omswastik-11 5d229c7
use minio in run migration
Omswastik-11 2a488ca
Merge branch 'main' into migration
geetu040 599c7e1
remove hardcoded server in TestHTTPClient.test_cache
geetu040 2867862
fix docstring in _resolve_default_cache_dir
geetu040 f09f3cd
fix docstring in ResourceAPI
geetu040 5f731ce
remove duplicates in __all__
geetu040 bad7842
remove ttl related code/docs
geetu040 aefdb38
remove delay methods in HTTPClient
geetu040 0f40b02
minor fix in _resolve_default_cache_dir
geetu040 7ac1672
update FallbackProxy
geetu040 6ac1dfe
simplify _backend creation
geetu040 62924c9
Merge branch 'main' into migration
geetu040 27696bb
req changes
satvshr 190face
resolve conflicts
satvshr 95daaa6
remove old config file
satvshr 7841ea8
added OPENML_TEST_SERVER_ADMIN_KEY_ENV_VAR
satvshr cc515aa
bug fixing
satvshr e6a92df
armagh fix
satvshr 1b8c22a
update content_type check
geetu040 fc839a6
Revert "make delay functions static"
geetu040 1c922af
Revert "remove delay methods in HTTPClient"
geetu040 ffa9ce9
Merge branch 'main' into migration
geetu040 a7b2d21
allow api_key=None
geetu040 27fe790
add tests for api_key=None
geetu040 8965112
update cache not found message
geetu040 72ea1a4
update docs for path in HTTPCache
geetu040 a696c49
remove elapsed from cached meta
geetu040 755636d
move self.headers to _HEADERS
geetu040 d07af34
fix indentation in docstrings of _resolve_default_cache_dir
geetu040 2d9c8ec
Update openml/_api/clients/http.py
geetu040 002b989
Merge branch 'main' into migration
geetu040 045d896
move _handle_delete_exception and_get_endpoint_name, legal_resources
geetu040 c437966
set HTTPClient.headers
geetu040 e27470a
remove main_tag
geetu040 d04d956
remove and merge TestAPIBase into TestBase
geetu040 9263f7f
minor change in TestHTTPClient.test_cache
geetu040 79dea29
make HTTPClient.request private
geetu040 f6497c2
Revert "update FallbackProxy"
geetu040 dce7f54
use st_ctime instead of st_ctime for cache refresh test
geetu040 40dd460
Merge branch 'main' into issue1564
geetu040 0fc917c
majore config refactor
geetu040 3d86b18
Merge branch 'pr-1577' into migration
geetu040 aba3d3e
update _config.py
geetu040 d99d54d
update test_openml_cache_dir_env_var
geetu040 dc22e3a
fix mutable SERVERS_REGISTRY
geetu040 7318573
update set_api_version for fallback
geetu040 29ef187
minor fix
geetu040 cf94c89
fixes for test_config
geetu040 298fbda
fixes in conftest urls
geetu040 9870502
update test_http.py
geetu040 33065c2
undo changes with test_openml_cache_dir_env_var
geetu040 76b92bb
fix server mode in test_config.py
geetu040 419edcb
move _HEADERS to confing
geetu040 cb6d937
add fixtures for migration tests
geetu040 8544c8a
update test_http.py with fixtures
geetu040 d4c413b
update test_versions.py
geetu040 fab1a15
update test_versions.py
geetu040 49789a7
merged latest changes related to testing
Omswastik-11 8b07a20
modified tests
Omswastik-11 276324a
fix error message in HTTPClient.server
geetu040 73f7594
fixes in test_versions.py: use DummyTaskAPI instead of TaskAPI
geetu040 2ee7fa3
add clients in openml._backend
geetu040 070731d
Merge branch 'migration' of https://github.com/geetu040/openml-python…
Omswastik-11 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,85 @@ | ||
| from .clients import ( | ||
| HTTPCache, | ||
| HTTPClient, | ||
| MinIOClient, | ||
| ) | ||
| from .resources import ( | ||
| API_REGISTRY, | ||
| DatasetAPI, | ||
| DatasetV1API, | ||
| DatasetV2API, | ||
| EstimationProcedureAPI, | ||
| EstimationProcedureV1API, | ||
| EstimationProcedureV2API, | ||
| EvaluationAPI, | ||
| EvaluationMeasureAPI, | ||
| EvaluationMeasureV1API, | ||
| EvaluationMeasureV2API, | ||
| EvaluationV1API, | ||
| EvaluationV2API, | ||
| FallbackProxy, | ||
| FlowAPI, | ||
| FlowV1API, | ||
| FlowV2API, | ||
| ResourceAPI, | ||
| ResourceV1API, | ||
| ResourceV2API, | ||
| RunAPI, | ||
| RunV1API, | ||
| RunV2API, | ||
| SetupAPI, | ||
| SetupV1API, | ||
| SetupV2API, | ||
| StudyAPI, | ||
| StudyV1API, | ||
| StudyV2API, | ||
| TaskAPI, | ||
| TaskV1API, | ||
| TaskV2API, | ||
| ) | ||
| from .setup import ( | ||
| APIBackend, | ||
| APIBackendBuilder, | ||
| _backend, | ||
| ) | ||
|
|
||
| __all__ = [ | ||
| "API_REGISTRY", | ||
| "APIBackend", | ||
| "APIBackendBuilder", | ||
| "DatasetAPI", | ||
| "DatasetV1API", | ||
| "DatasetV2API", | ||
| "EstimationProcedureAPI", | ||
| "EstimationProcedureV1API", | ||
| "EstimationProcedureV2API", | ||
| "EvaluationAPI", | ||
| "EvaluationMeasureAPI", | ||
| "EvaluationMeasureV1API", | ||
| "EvaluationMeasureV2API", | ||
| "EvaluationV1API", | ||
| "EvaluationV2API", | ||
| "FallbackProxy", | ||
| "FlowAPI", | ||
| "FlowV1API", | ||
| "FlowV2API", | ||
| "HTTPCache", | ||
| "HTTPClient", | ||
| "MinIOClient", | ||
| "ResourceAPI", | ||
| "ResourceV1API", | ||
| "ResourceV2API", | ||
| "RunAPI", | ||
| "RunV1API", | ||
| "RunV2API", | ||
| "SetupAPI", | ||
| "SetupV1API", | ||
| "SetupV2API", | ||
| "StudyAPI", | ||
| "StudyV1API", | ||
| "StudyV2API", | ||
| "TaskAPI", | ||
| "TaskV1API", | ||
| "TaskV2API", | ||
| "_backend", | ||
| ] | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| from .http import HTTPCache, HTTPClient | ||
| from .minio import MinIOClient | ||
|
|
||
| __all__ = [ | ||
| "HTTPCache", | ||
| "HTTPClient", | ||
| "MinIOClient", | ||
| ] |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
__all__contains duplicate entries (e.g.,FallbackProxyandResourceAPIare listed twice). This is harmless at runtime but makes exports harder to audit; please deduplicate the list.