tomleibo distributedSystems issues

tomleibo / distributedSystems

0 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

problem: the manager has no way to inform the local app that a task has failed

#72 hagai-lvi opened 8 years ago
0
AmazonS3Exception: The specified key does not exist in the local

#71 hagai-lvi closed 8 years ago
2
File not found exception in the manager

#70 hagai-lvi closed 8 years ago
1
multiple simultaneous tasks might start multiple batches of workers

#69 hagai-lvi closed 8 years ago
0
All the locals are uploading the inputfile with the same name

#68 hagai-lvi closed 8 years ago
0
Check time to finish running and add to README

#67 tomleibo closed 8 years ago
1
SQS queues for terminate and statistics

#66 hagai-lvi closed 8 years ago
1
Try to run worker on t2.micro (LP)

#65 tomleibo closed 8 years ago
0
Make sure that the manager doesn't save all tweets in the memory before writing to file

#64 hagai-lvi closed 8 years ago
0
make sure that the local doesn't send a terminate messgae if terminate=false

#63 hagai-lvi closed 8 years ago
0
Make sure that the recent messages that we have added are deleted from the queue

#62 hagai-lvi closed 8 years ago
0
check - statistics file isn't created

#61 hagai-lvi closed 8 years ago
1
Make the manager generate a random sqs queue name for each task

#60 hagai-lvi closed 8 years ago
0
BUG: when starting 2 locals in parallel, they start 2 managers

#59 hagai-lvi closed 8 years ago
3
Test scenarios

#58 hagai-lvi opened 8 years ago
1
Create different security group for each module (worker, manager)

#57 tomleibo opened 8 years ago
4
Termination is not implemented as required

#56 hagai-lvi closed 8 years ago
4
EC2 has 20 instances limitation

#55 hagai-lvi closed 8 years ago
2
Research and set optimal tweet-to-worker value

#54 tomleibo closed 8 years ago
0
Workers might overflow the sqs queue to the manager

#53 hagai-lvi closed 8 years ago
2
limit number of messages in the queue

#52 hagai-lvi closed 8 years ago
1
Add the css file to the result html

#51 hagai-lvi closed 8 years ago
2
Add headers to the table in the html file

#50 hagai-lvi closed 8 years ago
0
Add html colors

#49 hagai-lvi closed 8 years ago
0
make sure that the local app terminates the manager when needed

#48 hagai-lvi closed 8 years ago
1
Make the security groups and roles least priviliged

#47 hagai-lvi closed 8 years ago
1
Does the order of the tweets matter?

#46 hagai-lvi closed 8 years ago
2
Maybe use some kind of reactor instead of thread per task?

#45 hagai-lvi closed 8 years ago
2
Handle exceptions thrown from aws sdk

#44 hagai-lvi opened 8 years ago
3
Change all while(true) to while(! interrupted)

#43 hagai-lvi closed 8 years ago
3
remove all System.out.println()

#42 hagai-lvi closed 8 years ago
0
Make the result html more beautiful

#41 hagai-lvi closed 8 years ago
1
Make the manger take a limited number of tasks from the queue each time

#40 hagai-lvi closed 8 years ago
0
Who should terminate the manager and when?

#39 hagai-lvi closed 8 years ago
5
Make sure that the manager can handle empty or mis-formatted tweets files

#38 hagai-lvi closed 8 years ago
1
bh

#37 hagai-lvi closed 8 years ago
1
use aws sdk externally so that the jar will not be so big

#36 hagai-lvi closed 8 years ago
1
Make everything work in aws

#35 hagai-lvi closed 8 years ago
0
Takes a long time for the local to write the result file

#34 hagai-lvi closed 8 years ago
4
Should the workers be multithreaded?

#33 hagai-lvi closed 8 years ago
5
How to handle 404s and more unexpected behaviour?

#32 hagai-lvi closed 8 years ago
1
How to handle 404s and more unexpected behaviour?

#31 hagai-lvi closed 8 years ago
1
Make sure that the system can handle any crash scenario

#30 hagai-lvi closed 8 years ago
0
Handle errors - for example when the local can't find the src file

#29 hagai-lvi closed 8 years ago
0
Make sure that the visibility timeout of the sqs queues has a reasonable value, and that it is extended when needed

#28 hagai-lvi closed 8 years ago
2
NewTaskCommand should write the results file one line at a time

#27 hagai-lvi closed 8 years ago
0
delete local files in the manager

#26 hagai-lvi closed 8 years ago
0
NewTaskCommand should not read the whole file at once

#25 hagai-lvi closed 8 years ago
0
Make sure that we can scale

#24 hagai-lvi closed 8 years ago
0
Worker should extend visibility timeout

#23 hagai-lvi closed 8 years ago
0