issues
search
ManifoldRG
/
NEKO
In Progress Implementation of GATO style Generalist Multimodal model capable of image, text, RL and Robotics tasks
https://discord.gg/brsPnzNd8h
GNU General Public License v3.0
43
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
need to review next_token in predict_text function (code changes due to add_text_modality)
#25
henryj18
closed
11 months ago
1
Post text merge todo
#24
daniellawson9999
closed
11 months ago
0
Text eval without training
#23
daniellawson9999
closed
8 months ago
9
Better concatenation and individual metrics when using multiple text datasets
#22
bhavul
opened
11 months ago
5
Update README.md
#21
daniellawson9999
closed
1 year ago
0
Add image-caption task into NEKO project
#20
henryj18
opened
1 year ago
1
Create CONTRIBUTING.md
#19
harshsikka
closed
1 year ago
0
Score
#18
daniellawson9999
closed
1 year ago
0
Issues found in code review - series #1
#17
henryj18
opened
1 year ago
1
GATO paper tokenizing of Discrete values might be problematic
#16
henryj18
closed
1 year ago
3
Rename this "gato-control" repo to NEKO
#15
henryj18
closed
1 year ago
3
Introduce text modality into the repo
#14
bhavul
closed
10 months ago
1
Parallel Batch Sampling
#13
daniellawson9999
opened
1 year ago
0
Atari Datasets
#12
daniellawson9999
opened
1 year ago
1
Distributed Training
#11
daniellawson9999
opened
1 year ago
1
Training Experimental Roadmap
#10
daniellawson9999
opened
1 year ago
0
General Image encoding
#9
daniellawson9999
opened
1 year ago
1
Image positional encodings
#8
daniellawson9999
closed
1 year ago
0
Track unclipped reward/score for Atari
#7
daniellawson9999
closed
1 year ago
1
review control prompting strategy
#6
daniellawson9999
opened
1 year ago
0
optimize tokenization/embedding
#5
daniellawson9999
opened
1 year ago
0
Faster inference for evaluation
#4
daniellawson9999
opened
1 year ago
2
Distrib
#3
daniellawson9999
closed
1 year ago
0
gato control test
#2
harshsikka
closed
1 year ago
1
Add text modality, and some basic refactoring
#1
bhavul
closed
10 months ago
7
Data audit & Inventory
#37
helenlu66
closed
9 months ago
3
Test Issue
#38
sidhsikka1
opened
1 year ago
0
Dataset Tracker
#39
harshsikka
closed
8 months ago
4
Resource Analysis
#40
harshsikka
opened
1 year ago
6
v0 NEKO Model & System Designs
#41
harshsikka
opened
1 year ago
1
Update Neko planning doc with Model Training / Evaluation Issues
#42
harshsikka
closed
8 months ago
2
Port BabyAI GoToLocal Expert Trajectories To Minari
#43
helenlu66
opened
1 year ago
4
Multimodal Control Model Training
#44
harshsikka
closed
9 months ago
6
Investigate Video Modality Data
#45
harshsikka
opened
1 year ago
4
Investigate Audio Modality Datasets
#46
harshsikka
opened
1 year ago
5
Investigate Potential Use of Pretrained Models in Generalist /Massively Multimodal Setting
#47
harshsikka
opened
1 year ago
2
"Real-world" Multi-modal Robotics Control Datasets
#48
daniellawson9999
closed
8 months ago
3
Source MiniGrid/BabyAI Dataset
#49
daniellawson9999
opened
1 year ago
8
Scope Cost of using existing Open Source Datasets: Conceptual Captions, QKVQA, VQAv2
#50
atharva-tendle
closed
9 months ago
7
Investigate Alternative Datasets: LTIP
#51
atharva-tendle
closed
8 months ago
3
Investigate Alternative Datasets: M3W
#52
atharva-tendle
closed
8 months ago
3
Investigate Alternative Datasets: MassiveText
#53
atharva-tendle
closed
8 months ago
4
Previous