xtracthub xtract-service issues

xtracthub / xtract-service

Globus Labs Xtract: Extract metadata from distributed data sets.

6 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Web service support for custom container usage.

#68 tskluzac opened 2 years ago
0
current_app logging throughout (no prints)

#67 tskluzac opened 2 years ago
1
Getting dev up to speed w master

#66 tskluzac closed 2 years ago
0
Create CLI in python capable of fetching containers and running tests.

#65 tskluzac opened 2 years ago
0
Updated imagesort.py

#64 jvsr1 closed 3 years ago
0
configure_ep -- check status of endpoint prior to configuration

#63 jvsr1 opened 3 years ago
0
configure_endpoint_function -- check for valid 'xtract_path' argument

#62 jvsr1 opened 3 years ago
0
Configure funcx function -- first implementation

#61 jvsr1 closed 3 years ago
2
Dev to master.

#60 tskluzac closed 3 years ago
0
Smarter polling prioritization

#59 tskluzac closed 2 years ago
1
Built-in funcX rate limiting below 3000 requests per 5 mintues.

#58 tskluzac opened 3 years ago
0
Fix status logging to count number of tasks and number of batched tasks separately.

#57 tskluzac opened 3 years ago
0
Clean up obsolete test scripts and ADDING THETA SCALE TESTING.

#56 tskluzac closed 3 years ago
0
Adding test logic -- HPDC.

#55 tskluzac closed 3 years ago
0
xtract-hdf -> funcx func

#54 rewong03 closed 3 years ago
1
Add xtract-hdf to extractors

#53 rewong03 closed 3 years ago
0
xtract-netcdf -> funcx function

#52 rewong03 closed 3 years ago
0
xtract-jsonxlm -> funcx function

#51 rewong03 closed 3 years ago
0
Switching to have prefetch batches of 10k.

#50 tskluzac closed 3 years ago
1
add second comparison to tid_sublist condition

#49 zskluzac closed 3 years ago
0
Fix for snowballing requests issue.

#48 tskluzac closed 3 years ago
0
this ought to fix the 'runaway funcx args' issue?

#47 tskluzac closed 3 years ago
0
reducing active tasks on funcx. trying to fix funcx errors.

#46 tskluzac closed 3 years ago
0
Fixing puny prefetch size.

#45 tskluzac closed 3 years ago
0
Adding multi-threaded batch-sending for scale. Testing on EB.

#44 tskluzac closed 3 years ago
0
Getting rid of excessive test print.

#43 tskluzac closed 3 years ago
0
Memory reduction

#42 tskluzac closed 3 years ago
0
Minor testing (timestamp) bugfix.

#41 tskluzac closed 3 years ago
0
Changing test parameters and removing even more excess print statements.

#40 tskluzac closed 3 years ago
0
Cleaning up logs, editing test params.

#39 tskluzac closed 3 years ago
0
Memory reduction

#38 tskluzac closed 3 years ago
0
Memory reduction

#37 tskluzac closed 3 years ago
0
Trying to fix the path issues on EB.

#36 tskluzac closed 3 years ago
0
Too big of a commit...

#35 tskluzac closed 3 years ago
1
Memory issues in prefetcher.py

#34 tskluzac opened 3 years ago
0
[MDF] Append dataset metadata immediately after extraction

#33 tskluzac opened 3 years ago
0
Updating the mapping to enable Globus Group execution.

#32 tskluzac closed 3 years ago
0
Allow prefetch_remote (bool) to be submitted as part of the /extract request

#31 tskluzac opened 3 years ago
0
Orch cleanup

#30 tskluzac closed 3 years ago
0
Merge stylistic changes

#29 tskluzac closed 3 years ago
0
Smarter batching to take into account file size

#28 tskluzac opened 3 years ago
1
Return extraction progress in AP /status call

#27 jgaff opened 4 years ago
1
Validation metadata needs to be loaded with `json.loads()` twice

#26 rewong03 closed 3 years ago
3
Orchestrator.py is VERY MESSY. Need to document and clean it up.

#25 tskluzac opened 4 years ago
0
I think this is it

#24 wbrackenbury closed 4 years ago
0
Minhash add

#23 wbrackenbury closed 4 years ago
0
Crawl Limits

#22 blaiszik opened 4 years ago
1
GL: https://github.com/xtracthub/xtracthub-service/tree/master/gui

#21 tskluzac closed 3 years ago
1
GL: need to remove GUI folder

#20 tskluzac closed 3 years ago
1
GL: (Delete files after extraction) Copy Ryan's PR on the following extractors

#19 tskluzac opened 4 years ago
1