search

NiceSystems / hrider

hbase UI tool
Apache License 2.0
133 stars 45 forks source link

not able to export when data is more than 1000 rows #52

Open jeevitesh opened 10 years ago

jeevitesh commented 10 years ago

Hi, I'm using hrider 1.0.82 connected to hbase. I have rows numbering 1064, if i try to export it is exporting only 64 rows. I have checked the config(global properties) and increased writesize but still it not able to export more than 1000 rows

icher-g commented 10 years ago

Hi,

I will check this later but meanwhile why do you need export? What do you try to accomplish? You can change the rows number to more than 1064 before populating the table and click open in external editor. It will open in EXCEL by default and you will have all the rows exported in the comma delimited format I think.

jeevitesh commented 10 years ago

thanks for the replay... I need to export the data because I need to take backup... Or could that be size issue normally It will be around 100mb of data for 1000rows... so In global properties file i increased writeSize but no change in the behaviour And not able to understand why i need to create 1064 rows before populating thanks a lot..

On Wed, Aug 27, 2014 at 6:16 PM, Igor Cher notifications@github.com wrote:

Hi,

I will check this later but meanwhile why do you need export? What do you try to accomplish? You can change the rows number to more than 1064 before populating the table and click open in external editor. It will open in EXCEL by default and you will have all the rows exported in the comma delimited format I think.

— Reply to this email directly or view it on GitHub https://github.com/NiceSystems/hrider/issues/52#issuecomment-53566866.

icher-g commented 10 years ago

What version of the h-rider do you use? In the export dialog there are two options of export: as an .hfile or text delimited. The first option should work no matter how big your table. Keep in mind that to back up big table will take time because all the rows are being transferred into your local machine. You can also consider using hbase feature of backing up the tables. It is a map/reduce job that you can invoke from the command line.

jeevitesh commented 10 years ago

hi ignor, thanks for the replay... I'll consider those options please correct if i'm wrong track... I got this two set of java program to export hbase data to csv and import data.* so is this is the best option or is there any better option.* http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html thanks jeevitesh

On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher notifications@github.com wrote:

What version of the h-rider do you use? In the export dialog there are two options of export: as an .hfile or text delimited. The first option should work no matter how big your table. Keep in mind that to back up big table will take time because all the rows are being transferred into your local machine. You can also consider using hbase feature of backing up the tables. It is a map/reduce job that you can invoke from the command line.

— Reply to this email directly or view it on GitHub https://github.com/NiceSystems/hrider/issues/52#issuecomment-53681865.

jeevitesh commented 10 years ago

hi, tried both version h-rider-1.0.8.3-hbase-0.94.1 and h-rider-1.0.8.2-hbase-0.94.1 both having same issues not able to export

On Thu, Aug 28, 2014 at 1:00 PM, jeevi tesh jeevitesh.ms@gmail.com wrote:

hi ignor, thanks for the replay... I'll consider those options please correct if i'm wrong track... I got this two set of java program to export hbase data to csv and import data.* so is this is the best option or is there any better option.* http://www.mccarroll.net/snippets/hbaseload/HBaseExporter.java

http://hbase.apache.org/xref/org/apache/hadoop/hbase/mapreduce/SampleUploader.html thanks jeevitesh

On Thu, Aug 28, 2014 at 12:51 PM, Igor Cher notifications@github.com wrote:

What version of the h-rider do you use? In the export dialog there are two options of export: as an .hfile or text delimited. The first option should work no matter how big your table. Keep in mind that to back up big table will take time because all the rows are being transferred into your local machine. You can also consider using hbase feature of backing up the tables. It is a map/reduce job that you can invoke from the command line.

— Reply to this email directly or view it on GitHub https://github.com/NiceSystems/hrider/issues/52#issuecomment-53681865.

icher-g commented 10 years ago

Hi, There is a built in support for import/export tables from hbase. You can try them: http://hbase.apache.org/book.html#export