search

seznam / euphoria

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
Apache License 2.0
82 stars 11 forks source link

Why it is named as 'HadoopTextFileSource' #284

Closed kination closed 6 years ago

kination commented 6 years ago

Hello, this is just a simple question.

While looking sample source, I'm wander why source input class name has 'hadoop' in it because it is just working with local text file.

Could you answer this question? Also, if there is some kind of chat room to ask simple question like this?

Thanks.

dmvk commented 6 years ago

Hi,

the reason it is based on hadoop input format - TextInputFormat, which is designed primarily for HDFS but can work with local files as well.

You're welcome to join the ASF slack - https://s.apache.org/slack-invite and we'll invite you to beam-euphoria channel as we are currently in process of migrating our codebase into Apache Beam.

Thanks, D.

D.

kination commented 6 years ago

@dmvk Thanks! What is the meaning of migrating codebase into Beam project?