search

telefonicaid / fiware-cygnus

A connector in charge of persisting context data sources into other third-party databases and storage systems, creating a historical view of the context
https://fiware-cygnus.rtfd.io/
GNU Affero General Public License v3.0
64 stars 105 forks source link

[Cygnus-hadoop-row] the prefix is not appends in the organization #190

Closed iariasleon closed 10 years ago

iariasleon commented 10 years ago

example:

   cygnusagent.sinks.hdfs-sink.naming_prefix = cygnus_
   organization = org601
curl -i "http://10.95.82.70:50070/webhdfs/v1/user/cloud-user/?op=LISTSTATUS&user.name=cloud-user"
response:
{"FileStatuses":{"FileStatus":[
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16435,"group":"hdfs","length":0,"modificationTime":1410267154318,"owner":"cloud-user","pathSuffix":"a234567890abcdefghij1234","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16451,"group":"hdfs","length":0,"modificationTime":1410268343566,"owner":"cloud-user","pathSuffix":"attributes_multiples_3","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16457,"group":"hdfs","length":0,"modificationTime":1410268409398,"owner":"cloud-user","pathSuffix":"compound_1","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":4,"fileId":16478,"group":"hdfs","length":0,"modificationTime":1410354030521,"owner":"cloud-user","pathSuffix":"cygnus_col_default_1","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":5,"fileId":16417,"group":"hdfs","length":0,"modificationTime":1410267477945,"owner":"cloud-user","pathSuffix":"cygnus_test_default_6","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16454,"group":"hdfs","length":0,"modificationTime":1410268377111,"owner":"cloud-user","pathSuffix":"metadata_1","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16426,"group":"hdfs","length":0,"modificationTime":1410267123178,"owner":"cloud-user","pathSuffix":"org601","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16429,"group":"hdfs","length":0,"modificationTime":1410267133598,"owner":"cloud-user","pathSuffix":"orga601","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":16432,"group":"hdfs","length":0,"modificationTime":1410267143915,"owner":"cloud-user","pathSuffix":"orga_61","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16885,"group":"hdfs","length":0,"modificationTime":1410520656462,"owner":"cloud-user","pathSuffix":"pepe_001","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":16393,"group":"hdfs","length":0,"modificationTime":1407328570272,"owner":"cloud-user","pathSuffix":"terasort-input","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":16402,"group":"hdfs","length":0,"modificationTime":1407328597535,"owner":"cloud-user","pathSuffix":"terasort-output","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16410,"group":"hdfs","length":0,"modificationTime":1407328618742,"owner":"cloud-user","pathSuffix":"terasort-validate","permission":"755","replication":0,"type":"DIRECTORY"},
{"accessTime":1407328380691,"blockSize":134217728,"childrenNum":0,"fileId":16392,"group":"hdfs","length":15,"modificationTime":1407328380691,"owner":"cloud-user","pathSuffix":"test","permission":"644","replication":2,"type":"FILE"}
]}}
frbattid commented 10 years ago

I think this is a matter of deciding if we want the organization is being prefixed as well. Even, if we want to maintain the prefixing functionality...

Anyway, a workaround would be to manually prefixing the organization:

cygnusagent.sinks.hdfs-sink.naming_prefix = cygnus_
organization = cygnus_org601
frbattid commented 10 years ago

This issue has been closed since the prefixing feature is definetely going to be discarded: https://github.com/telefonicaid/fiware-connectors/issues/224