full volumes and still trying to assign fkey

[GoogleCodeExporter]

What steps will reproduce the problem?
1. created two volumes 8080/8081
2. run weed upload -dir=/dir
3. two first full / created to others 8082/8083

What is the expected output? What do you see instead?
Not trying to assign a fkey on 8080 and 8081

What version of the product are you using? On what operating system?
0.37

Please provide any additional information below.
Have run the command "curl "http://localhost:9333/vol/vacuum"

Original issue reported on code.google.com by Michalsk...@gmail.com on 8 Aug 2013 at 8:59

[GoogleCodeExporter]

How long did this error last? There will be some delays when a volume becomes 
full and the status are reflected on master server. Did the master server 
finally stop assigning keys to 8080 and 8081?

Original comment by chris...@gmail.com on 8 Aug 2013 at 9:15

[GoogleCodeExporter]

If it is due to the delay, the fix would be to add a re-try logic to handle 
upload failure.

Original comment by chris...@gmail.com on 8 Aug 2013 at 9:22

[GoogleCodeExporter]

24 hours ^^ I have stopped the master and restarted all volumes and still the 
same... there is no space left on the partition hosting 8081 and 8081

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 9:24

[GoogleCodeExporter]

Please collect these information:

http://localhost:8080/status?pretty=y
http://localhost:8081/status?pretty=y
http://localhost:9333/dir/status?pretty=y

Original comment by chris...@gmail.com on 8 Aug 2013 at 9:40

[GoogleCodeExporter]

Also, is there any firewall that could possibly block http requests sent from 
volume servers to master?

Original comment by chris...@gmail.com on 8 Aug 2013 at 9:45

[GoogleCodeExporter]

nope that's the same instance with different ebs volumes... Will grab all 
informations in a second

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 9:48

[GoogleCodeExporter]

$ curl http://localhost:8080/status?pretty=y
{
  "Version": "0.37",
  "Volumes": [
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52104,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52401,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51543,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

$ curl http://localhost:8081/status?pretty=y
{
  "Version": "0.37",
  "Volumes": [
    {
      "Id": 10,
      "Size": 34359793194,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799394,
      "DeleteCount": 388,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 11,
      "Size": 34359896499,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798817,
      "DeleteCount": 383,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 19,
      "Size": 34359781079,
      "RepType": "000",
      "Version": 2,
      "FileCount": 593384,
      "DeleteCount": 553,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 3,
      "Size": 34359837177,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575128,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 6,
      "Size": 34359903513,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574248,
      "DeleteCount": 7,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 7,
      "Size": 34359751291,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574639,
      "DeleteCount": 16,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 26,
      "Size": 3101470041,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51842,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 4,
      "Size": 34359790973,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574601,
      "DeleteCount": 13,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 8,
      "Size": 34346565473,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798335,
      "DeleteCount": 360,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 9,
      "Size": 34354286636,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799056,
      "DeleteCount": 369,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

$ curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": -31,
        "Max": 8,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": -7,
                "Max": 2,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": -8,
                "Max": 2,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": -8,
                "Max": 2,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              },
              {
                "Free": -8,
                "Max": 2,
                "PublicUrl": "localhost:8084",
                "Url": "localhost:8084",
                "Volumes": 10
              }
            ],
            "Free": -31,
            "Max": 8
          }
        ]
      }
    ],
    "Free": -31,
    "Max": 8,
    "layouts": [
      {
        "replication": "000",
        "writables": [
          22,
          31,
          32,
          26
        ]
      }
    ]
  },
  "Version": "0.37"
}

 curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": 1,
        "Max": 40,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": 1,
                "Max": 10,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8082",
                "Url": "localhost:8082",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              }
            ],
            "Free": 1,
            "Max": 40
          }
        ]
      }
    ],
    "Free": 1,
    "Max": 40,
    "layouts": [
      {
        "replication": "000",
        "writables": [
          22,
          31,
          32,
          26
        ]
      }
    ]
  },
  "Version": "0.37"
}

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 9:54

[GoogleCodeExporter]

The 4 volumes with id 22,31,32,26 are not full yet. They are close to 32GB, but 
not yet. So it is fine that some keys are assigned to them?

{
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52104,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52401,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51543,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 26,
      "Size": 3101470041,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51842,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },

Original comment by chris...@gmail.com on 8 Aug 2013 at 10:07

[GoogleCodeExporter]

Yes, but when I use weed upload in the output I have always the following 
message:

[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44768181_6a4a4b9d2bfeef0
75acdb7f1f77b9ae9.png","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44768985_3e2e35f4f031e6e
851669ff10923d852.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44768986_5e44ba701a9fca1
942b5ac0cb7952d2c.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769160_db4bfb63e99d912
68275351728b32d76.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769165_0886024e96bdd24
1161bd215573540d3.jpg","fileUrl":"localhost:8081/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data2/26.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769166_83bdb9c813303e9
6488c0d67d06fcd7f.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/31.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769170_39ea7a7dc28f69e
8a9a60015af3caf1b.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/31.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769177_1f8ea5b42497023
f84f44f2f11eed341.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769178_bc45b062feb762f
e8972bc698e84d7db.jpg","fileUrl":"localhost:8081/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data2/26.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769180_6b0e0c9cacbb25c
3f165d3fb4b65ac51.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769181_48ebcb6d707ff5d
fa5b2fc79fae1376a.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769182_5bdf75444c21271
8e4a4b10022f30d9b.jpg","fileUrl":"localhost:8081/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data2/26.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769183_6126557e2a9e425
5df44d9b07fbc3e35.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769184_8b3ab5d632866d6
4ea5170faf37e2322.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/31.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769185_b046427787c8556
be94c3316d7aa10f1.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769188_e5f2a90965f4ddc
e5dc3ff6e6f2f11bd.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769189_15e454ca5c4f9a4
651696c5558e5382d.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/31.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769190_17a60af848d323c
9091986dd1537a27e.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/31.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769191_52b9384feddb2f2
2ad7607cef3d5ad8e.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/13b24bfee84a0c81cdd38edf41dd5d4b/44769195_e0b7d548deebffe
289e7fccfe9791717.jpg","fileUrl":"localhost:8081/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data2/26.dat: no space left on 
device)"}]

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 10:14

[GoogleCodeExporter]

The disk is really full then. Good bug! Please work around this by make the 
.dat files read only. And restart volume servers maybe. I will put in a fix for 
this later.

Original comment by chris...@gmail.com on 8 Aug 2013 at 10:22

[GoogleCodeExporter]

I have done a chmod 444 on all files in /cdn/data1 and /cdn/data2, restarted 
and no luck...

[{"fileName":"/sources/b349eeda8ee1f3dc34528fd83ff89833/88260902_4ce6e37518112ab
75582068e0c562869.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/32.dat: no space left on 
device)"}]
[{"fileName":"/sources/b349eeda8ee1f3dc34528fd83ff89833/88260903_6d4f4a002e0b888
241d3e68a1eae478c.jpg","fileUrl":"localhost:8080/","fid":"","size":0,"error":"Fa
iled to write to local disk (write /cdn/data1/22.dat: no space left on 
device)"}]

Is it possible to get all fkeys created as I would like to remove any duplicate 
content ?

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 10:28

[GoogleCodeExporter]

btw, thanks for your time ! :-)

Original comment by Michalsk...@gmail.com on 8 Aug 2013 at 10:29

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Thanks for your details! Please collect again the status from the 3 urls. I 
will look into that.

Original comment by chris...@gmail.com on 9 Aug 2013 at 1:10

[GoogleCodeExporter]

Below, the status of the three URLs:

$ curl http://localhost:8080/status?pretty=y
{
  "Version": "0.37",
  "Volumes": [
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

$curl http://localhost:8081/status?pretty=y
{
  "Version": "0.37",
  "Volumes": [
    {
      "Id": 19,
      "Size": 34359781079,
      "RepType": "000",
      "Version": 2,
      "FileCount": 593384,
      "DeleteCount": 553,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 3,
      "Size": 34359837177,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575128,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 7,
      "Size": 34359751291,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574639,
      "DeleteCount": 16,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 8,
      "Size": 34346565473,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798335,
      "DeleteCount": 360,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 9,
      "Size": 34354286636,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799056,
      "DeleteCount": 369,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 10,
      "Size": 34359793194,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799394,
      "DeleteCount": 388,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 11,
      "Size": 34359896499,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798817,
      "DeleteCount": 383,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 26,
      "Size": 3101470041,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51846,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 4,
      "Size": 34359790973,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574601,
      "DeleteCount": 13,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 6,
      "Size": 34359903513,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574248,
      "DeleteCount": 7,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

$  curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": 1,
        "Max": 40,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": 1,
                "Max": 10,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8082",
                "Url": "localhost:8082",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              }
            ],
            "Free": 1,
            "Max": 40
          }
        ]
      }
    ],
    "Free": 1,
    "Max": 40,
    "layouts": [
      {
        "replication": "000",
        "writables": [
          22,
          31,
          32,
          26
        ]
      }
    ]
  },
  "Version": "0.37"
}

Original comment by Luc.Mich...@blippar.com on 9 Aug 2013 at 7:54

[GoogleCodeExporter]

Please wait half an hour and use the newly uploaded v0.38 to see whether it 
helps. Or you can build v0.38 weed from the git HEAD.

Original comment by chris...@gmail.com on 9 Aug 2013 at 8:11

[GoogleCodeExporter]

Will do, and keep you updated

Original comment by Luc.Mich...@blippar.com on 9 Aug 2013 at 8:12

[GoogleCodeExporter]

Did the new version 0.38 help?

Original comment by chris...@gmail.com on 10 Aug 2013 at 2:35

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Are the *.dat files are readonly?

Could you please send me the console output when the volume server starts?

Chris

Original comment by chris...@gmail.com on 10 Aug 2013 at 8:17

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

weed volume -dir="/cdn/data1" -max=10 -mserver="localhost:9333" -port=8080 &
I0811 09:46:26 26931 volume.go:329] Volume Folder /cdn/data1
I0811 09:46:26 26931 volume.go:330] Permission: -rwxr-xr-x
I0811 09:46:26 26931 store.go:166] In dir /cdn/data1 read volume = 1 
replicationType = 000 version = 2 size = 34373857712
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 12 
replicationType = 000 version = 2 size = 34379298472
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 13 
replicationType = 000 version = 2 size = 34376306464
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 14 
replicationType = 000 version = 2 size = 34379419456
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 2 
replicationType = 000 version = 2 size = 34373909984
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 22 
replicationType = 000 version = 2 size = 3125153776
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 31 
replicationType = 000 version = 2 size = 3121307640
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 32 
replicationType = 000 version = 2 size = 3104083952
I0811 09:46:27 26931 store.go:166] In dir /cdn/data1 read volume = 5 
replicationType = 000 version = 2 size = 34368039456
I0811 09:46:27 26931 store.go:173] Store started on dir: /cdn/data1 with 9 
volumes max 10
I0811 09:46:27 26931 volume.go:368] store joined at localhost:9333
I0811 09:46:27 26931 volume.go:370] Start Weed volume server 0.38 at 
http://localhost:8080
I0811 09:46:27 26924 node.go:158] topo adds child DefaultDataCenter
I0811 09:46:27 26924 node.go:158] topo:DefaultDataCenter adds child DefaultRack
I0811 09:46:27 26924 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8080
I0811 09:46:27 26924 topology.go:105] adding replication type 000

weed volume -dir="/cdn/data2" -max=10 -mserver="localhost:9333" -port=8081 &
I0811 09:47:09 26942 volume.go:329] Volume Folder /cdn/data2
I0811 09:47:09 26942 volume.go:330] Permission: -rwxr-xr-x
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 10 
replicationType = 000 version = 2 size = 34379380944
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 11 
replicationType = 000 version = 2 size = 34379470048
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 19 
replicationType = 000 version = 2 size = 34374302952
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 26 
replicationType = 000 version = 2 size = 3102736384
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 3 
replicationType = 000 version = 2 size = 34373888840
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 4 
replicationType = 000 version = 2 size = 34373828840
I0811 09:47:10 26942 store.go:166] In dir /cdn/data2 read volume = 6 
replicationType = 000 version = 2 size = 34373936336
I0811 09:47:11 26942 store.go:166] In dir /cdn/data2 read volume = 7 
replicationType = 000 version = 2 size = 34373793480
I0811 09:47:11 26942 store.go:166] In dir /cdn/data2 read volume = 8 
replicationType = 000 version = 2 size = 34366125792
I0811 09:47:11 26942 store.go:166] In dir /cdn/data2 read volume = 9 
replicationType = 000 version = 2 size = 34373863544
I0811 09:47:11 26942 store.go:173] Store started on dir: /cdn/data2 with 10 
volumes max 10
I0811 09:47:11 26942 volume.go:368] store joined at localhost:9333
I0811 09:47:11 26942 volume.go:370] Start Weed volume server 0.38 at 
http://localhost:8081
I0811 09:47:11 26924 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8081

weed volume -dir="/cdn2/data3" -max=10 -mserver="localhost:9333" -port=8082 &
I0811 09:48:04 26953 volume.go:329] Volume Folder /cdn2/data3
I0811 09:48:04 26953 volume.go:330] Permission: -rwxr-xr-x
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 15 
replicationType = 000 version = 2 size = 34374398696
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 16 
replicationType = 000 version = 2 size = 34367703400
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 18 
replicationType = 000 version = 2 size = 34374370672
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 20 
replicationType = 000 version = 2 size = 34368368992
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 23 
replicationType = 000 version = 2 size = 34364647712
I0811 09:48:05 26953 store.go:166] In dir /cdn2/data3 read volume = 24 
replicationType = 000 version = 2 size = 34362463112
I0811 09:48:06 26953 store.go:166] In dir /cdn2/data3 read volume = 27 
replicationType = 000 version = 2 size = 34367290096
I0811 09:48:06 26953 store.go:166] In dir /cdn2/data3 read volume = 30 
replicationType = 000 version = 2 size = 34364516552
I0811 09:48:06 26953 store.go:166] In dir /cdn2/data3 read volume = 35 
replicationType = 000 version = 2 size = 34364870832
I0811 09:48:06 26953 store.go:166] In dir /cdn2/data3 read volume = 36 
replicationType = 000 version = 2 size = 34370903584
I0811 09:48:06 26953 store.go:173] Store started on dir: /cdn2/data3 with 10 
volumes max 10
I0811 09:48:06 26953 volume.go:368] store joined at localhost:9333
I0811 09:48:06 26953 volume.go:370] Start Weed volume server 0.38 at 
http://localhost:8082
I0811 09:48:06 26924 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8082

I0811 09:48:42 26965 volume.go:329] Volume Folder /cdn2/data4
I0811 09:48:42 26965 volume.go:330] Permission: -rwxr-xr-x
I0811 09:48:42 26965 store.go:166] In dir /cdn2/data4 read volume = 17 
replicationType = 000 version = 2 size = 34374402624
I0811 09:48:42 26965 store.go:166] In dir /cdn2/data4 read volume = 21 
replicationType = 000 version = 2 size = 34374279704
I0811 09:48:42 26965 store.go:166] In dir /cdn2/data4 read volume = 25 
replicationType = 000 version = 2 size = 34365393376
I0811 09:48:42 26965 store.go:166] In dir /cdn2/data4 read volume = 29 
replicationType = 000 version = 2 size = 34365086648
I0811 09:48:43 26965 store.go:166] In dir /cdn2/data4 read volume = 33 
replicationType = 000 version = 2 size = 34365254056
I0811 09:48:43 26965 store.go:166] In dir /cdn2/data4 read volume = 34 
replicationType = 000 version = 2 size = 34366156312
I0811 09:48:43 26965 store.go:166] In dir /cdn2/data4 read volume = 37 
replicationType = 000 version = 2 size = 34367088872
I0811 09:48:43 26965 store.go:166] In dir /cdn2/data4 read volume = 38 
replicationType = 000 version = 2 size = 34364223432
I0811 09:48:43 26965 store.go:166] In dir /cdn2/data4 read volume = 39 
replicationType = 000 version = 2 size = 34361510000
I0811 09:48:44 26965 store.go:166] In dir /cdn2/data4 read volume = 40 
replicationType = 000 version = 2 size = 34368824216
I0811 09:48:44 26965 store.go:173] Store started on dir: /cdn2/data4 with 10 
volumes max 10
I0811 09:48:44 26965 volume.go:368] store joined at localhost:9333
I0811 09:48:44 26965 volume.go:370] Start Weed volume server 0.38 at 
http://localhost:8083
I0811 09:48:44 26924 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8083

ls -l
-r--r--r-- 1 user user 34379298472 Aug  7 03:42 12.dat
-r--r--r-- 1 user user    12764640 Aug  7 03:42 12.idx
-r--r--r-- 1 user user 34376306464 Aug  7 03:42 13.dat
-r--r--r-- 1 user user    12780784 Aug  7 03:42 13.idx
-r--r--r-- 1 user user 34379419456 Aug  7 03:42 14.dat
-r--r--r-- 1 user user    12802272 Aug  7 03:42 14.idx
-r--r--r-- 1 user user 34373857712 Aug  6 21:13 1.dat
-r--r--r-- 1 user user     9202592 Aug  6 21:13 1.idx
-r--r--r-- 1 user user  3125153776 Aug  8 22:41 22.dat
-r--r--r-- 1 user user      833856 Aug  8 20:58 22.idx
-r--r--r-- 1 user user           0 Aug  8 12:22 28.dat
-r--r--r-- 1 user user           0 Aug  7 23:30 28.idx
-r--r--r-- 1 user user 34373909984 Aug  6 21:05 2.dat
-r--r--r-- 1 user user     9202080 Aug  6 21:05 2.idx
-r--r--r-- 1 user user  3121307640 Aug  8 22:41 31.dat
-r--r--r-- 1 user user      838496 Aug  8 20:58 31.idx
-r--r--r-- 1 user user  3104083952 Aug  8 22:41 32.dat
-r--r--r-- 1 user user      824832 Aug  8 20:58 32.idx
-r--r--r-- 1 user user 34368039456 Aug  8 11:45 5.dat
-r--r--r-- 1 user user     9199120 Aug  8 11:45 5.idx

curl http://localhost:8080/status?pretty=y
{
  "Version": "0.38",
  "Volumes": [
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

Original comment by Michalsk...@gmail.com on 11 Aug 2013 at 9:52

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Please let me know whether changing *.idx file to 644 can resolve the problem. 
And then restart the volume servers.

chmod 444 /cdn/data1/*.dat
chmod 444 /cdn/data2/*.dat
chmod 644 /cdn/data1/*.idx
chmod 644 /cdn/data2/*.idx

Original comment by chris...@gmail.com on 11 Aug 2013 at 6:46

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Changed permissions and restarted volumes but no luck, still tagged as readonly 
= false.

 curl http://localhostcurl http://localhost:8080/status?pretty=y
{
  "Version": "0.38",
  "Volumes": [
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

Original comment by Michalsk...@gmail.com on 11 Aug 2013 at 6:58

[GoogleCodeExporter]

What's your OS? Linux 64bit? I can send you a new build, or you can build it 
directly from git. And please use this command to start the volume server, and 
send me the console output.
 weed -v=4 volume -dir="/cdn/data1" -max=10 -mserver="localhost:9333" -port=8080 &

Original comment by chris...@gmail.com on 11 Aug 2013 at 8:21

[GoogleCodeExporter]

Yes, I am using an Ubuntu 64Bits:
Distributor ID: Ubuntu
Description:    Ubuntu 12.04.2 LTS
Release:    12.04
Codename:   precise

Can you send me the new build ?

Original comment by Michalsk...@gmail.com on 11 Aug 2013 at 8:35

[GoogleCodeExporter]

Here is a testing weed.gz

Original comment by chris...@gmail.com on 11 Aug 2013 at 9:42

Attachments:

• weed.gz

[GoogleCodeExporter]

Cheers, will test it now!

Original comment by Michalsk...@gmail.com on 11 Aug 2013 at 9:43

[GoogleCodeExporter]

I cannot uncompress it? is it a tar.gz ? when I unzip it , I have a file called 
"weed" wihtout extension.

Original comment by Michalsk...@gmail.com on 11 Aug 2013 at 10:00

[GoogleCodeExporter]

gzip -d weed.gz

Original comment by chris...@gmail.com on 11 Aug 2013 at 10:17

[GoogleCodeExporter]

No luck again,

 curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": 1,
        "Max": 40,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": 1,
                "Max": 10,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8082",
                "Url": "localhost:8082",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              }
            ],
            "Free": 1,
            "Max": 40
          }
        ]
      }
    ],
    "Free": 1,
    "Max": 40,
    "layouts": [
      {
        "replication": "000",
        "writables": [
          22,
          32,
          31,
          26
        ]
      }
    ]
  },
  "Version": "0.39"
}

$ curl http://localhost:8080/status?pretty=y
{
  "Version": "0.39",
  "Volumes": [
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}

# weed volume -dir="/cdn2/data4" -max=10 -mserver="localhost:9333" -port=8083 &
I0812 19:10:57 30581 volume.go:329] Volume Folder /cdn2/data4
I0812 19:10:57 30581 volume.go:330] Permission: -rwxr-xr-x
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/17.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 17 
replicationType = 000 version = 2 size = 34374402624
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/21.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 21 
replicationType = 000 version = 2 size = 34374279704
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/25.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 25 
replicationType = 000 version = 2 size = 34365393376
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/29.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 29 
replicationType = 000 version = 2 size = 34365086648
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/33.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 33 
replicationType = 000 version = 2 size = 34365254056
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/34.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 34 
replicationType = 000 version = 2 size = 34366156312
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/37.idx readonly 
false
I0812 19:10:57 30581 store.go:166] In dir /cdn2/data4 read volume = 37 
replicationType = 000 version = 2 size = 34367088872
I0812 19:10:57 30581 volume.go:115] loading file /cdn2/data4/38.idx readonly 
false
I0812 19:10:58 30581 store.go:166] In dir /cdn2/data4 read volume = 38 
replicationType = 000 version = 2 size = 34364223432
I0812 19:10:58 30581 volume.go:115] loading file /cdn2/data4/39.idx readonly 
false
I0812 19:10:58 30581 store.go:166] In dir /cdn2/data4 read volume = 39 
replicationType = 000 version = 2 size = 34361510000
I0812 19:10:58 30581 volume.go:115] loading file /cdn2/data4/40.idx readonly 
false
I0812 19:10:58 30581 store.go:166] In dir /cdn2/data4 read volume = 40 
replicationType = 000 version = 2 size = 34368824216
I0812 19:10:58 30581 store.go:173] Store started on dir: /cdn2/data4 with 10 
volumes max 10
I0812 19:10:58 30581 volume.go:368] store joined at localhost:9333
I0812 19:10:58 30581 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8083
I0812 19:10:58 30541 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8083

# weed volume -dir="/cdn2/data3" -max=10 -mserver="localhost:9333" -port=8082 &
[4] 30570
I0812 19:10:49 30570 volume.go:329] Volume Folder /cdn2/data3
I0812 19:10:49 30570 volume.go:330] Permission: -rwxr-xr-x
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/15.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 15 
replicationType = 000 version = 2 size = 34374398696
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/16.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 16 
replicationType = 000 version = 2 size = 34367703400
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/18.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 18 
replicationType = 000 version = 2 size = 34374370672
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/20.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 20 
replicationType = 000 version = 2 size = 34368368992
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/23.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 23 
replicationType = 000 version = 2 size = 34364647712
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/24.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 24 
replicationType = 000 version = 2 size = 34362463112
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/27.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 27 
replicationType = 000 version = 2 size = 34367290096
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/30.idx readonly 
false
I0812 19:10:49 30570 store.go:166] In dir /cdn2/data3 read volume = 30 
replicationType = 000 version = 2 size = 34364516552
I0812 19:10:49 30570 volume.go:115] loading file /cdn2/data3/35.idx readonly 
false
I0812 19:10:50 30570 store.go:166] In dir /cdn2/data3 read volume = 35 
replicationType = 000 version = 2 size = 34364870832
I0812 19:10:50 30570 volume.go:115] loading file /cdn2/data3/36.idx readonly 
false
I0812 19:10:50 30570 store.go:166] In dir /cdn2/data3 read volume = 36 
replicationType = 000 version = 2 size = 34370903584
I0812 19:10:50 30570 store.go:173] Store started on dir: /cdn2/data3 with 10 
volumes max 10
I0812 19:10:50 30570 volume.go:368] store joined at localhost:9333
I0812 19:10:50 30570 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8082
I0812 19:10:50 30541 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8082

weed volume -dir="/cdn/data2" -max=10 -mserver="localhost:9333" -port=8081 &
[3] 30559
I0812 19:10:43 30559 volume.go:329] Volume Folder /cdn/data2
I0812 19:10:43 30559 volume.go:330] Permission: -rwxr-xr-x
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/10.idx readonly 
false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 10 
replicationType = 000 version = 2 size = 34379380944
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/11.idx readonly 
false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 11 
replicationType = 000 version = 2 size = 34379470048
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/19.idx readonly 
false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 19 
replicationType = 000 version = 2 size = 34374302952
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/26.idx readonly 
false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 26 
replicationType = 000 version = 2 size = 3102736384
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/3.idx readonly false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 3 
replicationType = 000 version = 2 size = 34373888840
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/4.idx readonly false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 4 
replicationType = 000 version = 2 size = 34373828840
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/6.idx readonly false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 6 
replicationType = 000 version = 2 size = 34373936336
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/7.idx readonly false
I0812 19:10:43 30559 store.go:166] In dir /cdn/data2 read volume = 7 
replicationType = 000 version = 2 size = 34373793480
I0812 19:10:43 30559 volume.go:115] loading file /cdn/data2/8.idx readonly false
I0812 19:10:44 30559 store.go:166] In dir /cdn/data2 read volume = 8 
replicationType = 000 version = 2 size = 34366125792
I0812 19:10:44 30559 volume.go:115] loading file /cdn/data2/9.idx readonly false
I0812 19:10:44 30559 store.go:166] In dir /cdn/data2 read volume = 9 
replicationType = 000 version = 2 size = 34373863544
I0812 19:10:44 30559 store.go:173] Store started on dir: /cdn/data2 with 10 
volumes max 10
I0812 19:10:44 30559 volume.go:368] store joined at localhost:9333
I0812 19:10:44 30559 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8081
I0812 19:10:44 30541 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8081

# I0812 19:10:25 30548 volume.go:329] Volume Folder /cdn/data1
I0812 19:10:25 30548 volume.go:330] Permission: -rwxr-xr-x
I0812 19:10:25 30548 volume.go:115] loading file /cdn/data1/1.idx readonly false
I0812 19:10:25 30548 store.go:166] In dir /cdn/data1 read volume = 1 
replicationType = 000 version = 2 size = 34373857712
I0812 19:10:25 30548 volume.go:115] loading file /cdn/data1/12.idx readonly 
false
I0812 19:10:25 30548 store.go:166] In dir /cdn/data1 read volume = 12 
replicationType = 000 version = 2 size = 34379298472
I0812 19:10:25 30548 volume.go:115] loading file /cdn/data1/13.idx readonly 
false
I0812 19:10:25 30548 store.go:166] In dir /cdn/data1 read volume = 13 
replicationType = 000 version = 2 size = 34376306464
I0812 19:10:25 30548 volume.go:115] loading file /cdn/data1/14.idx readonly 
false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 14 
replicationType = 000 version = 2 size = 34379419456
I0812 19:10:26 30548 volume.go:115] loading file /cdn/data1/2.idx readonly false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 2 
replicationType = 000 version = 2 size = 34373909984
I0812 19:10:26 30548 volume.go:115] loading file /cdn/data1/22.idx readonly 
false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 22 
replicationType = 000 version = 2 size = 3125153776
I0812 19:10:26 30548 volume.go:115] loading file /cdn/data1/31.idx readonly 
false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 31 
replicationType = 000 version = 2 size = 3121307640
I0812 19:10:26 30548 volume.go:115] loading file /cdn/data1/32.idx readonly 
false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 32 
replicationType = 000 version = 2 size = 3104083952
I0812 19:10:26 30548 volume.go:115] loading file /cdn/data1/5.idx readonly false
I0812 19:10:26 30548 store.go:166] In dir /cdn/data1 read volume = 5 
replicationType = 000 version = 2 size = 34368039456
I0812 19:10:26 30548 store.go:173] Store started on dir: /cdn/data1 with 9 
volumes max 10
I0812 19:10:26 30548 volume.go:368] store joined at localhost:9333
I0812 19:10:26 30548 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8080
I0812 19:10:26 30541 node.go:158] topo adds child DefaultDataCenter
I0812 19:10:26 30541 node.go:158] topo:DefaultDataCenter adds child DefaultRack
I0812 19:10:26 30541 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8080
I0812 19:10:26 30541 topology.go:105] adding replication type 000

Original comment by Michalsk...@gmail.com on 12 Aug 2013 at 7:14

[GoogleCodeExporter]

Please do a "ls -al" on the data folders.

Original comment by chris...@gmail.com on 12 Aug 2013 at 7:25

[GoogleCodeExporter]

-r--r--r-- 1 root root 34379298472 Aug  7 03:42 12.dat
-rw-r--r-- 1 root root    12764640 Aug  7 03:42 12.idx
-r--r--r-- 1 root root 34376306464 Aug  7 03:42 13.dat
-rw-r--r-- 1 root root    12780784 Aug  7 03:42 13.idx
-r--r--r-- 1 root root 34379419456 Aug  7 03:42 14.dat
-rw-r--r-- 1 root root    12802272 Aug  7 03:42 14.idx
-r--r--r-- 1 root root 34373857712 Aug  6 21:13 1.dat
-rw-r--r-- 1 root root     9202592 Aug  6 21:13 1.idx
-r--r--r-- 1 root root  3125153776 Aug  8 22:41 22.dat
-rw-r--r-- 1 root root      833856 Aug  8 20:58 22.idx
-r--r--r-- 1 root root           0 Aug  8 12:22 28.dat
-rw-r--r-- 1 root root           0 Aug  7 23:30 28.idx
-r--r--r-- 1 root root 34373909984 Aug  6 21:05 2.dat
-rw-r--r-- 1 root root     9202080 Aug  6 21:05 2.idx
-r--r--r-- 1 root root  3121307640 Aug  8 22:41 31.dat
-rw-r--r-- 1 root root      838496 Aug  8 20:58 31.idx
-r--r--r-- 1 root root  3104083952 Aug  8 22:41 32.dat
-rw-r--r-- 1 root root      824832 Aug  8 20:58 32.idx
-r--r--r-- 1 root root 34368039456 Aug  8 11:45 5.dat
-rw-r--r-- 1 root root     9199120 Aug  8 11:45 5.idx

-r--r--r-- 1 root root 34379380944 Aug  7 03:42 10.dat
-rw-r--r-- 1 root root    12790304 Aug  7 03:42 10.idx
-r--r--r-- 1 root root 34379470048 Aug  7 03:42 11.dat
-rw-r--r-- 1 root root    12781072 Aug  7 03:42 11.idx
-r--r--r-- 1 root root 34374302952 Aug  7 12:05 19.dat
-rw-r--r-- 1 root root     9494144 Aug  7 12:05 19.idx
-r--r--r-- 1 root root  3102736384 Aug  8 22:41 26.dat
-rw-r--r-- 1 root root      829536 Aug  8 20:58 26.idx
-r--r--r-- 1 root root 34373888840 Aug  6 21:05 3.dat
-rw-r--r-- 1 root root     9202048 Aug  6 21:05 3.idx
-r--r--r-- 1 root root 34373828840 Aug  6 21:05 4.dat
-rw-r--r-- 1 root root     9193616 Aug  6 21:05 4.idx
-r--r--r-- 1 root root 34373936336 Aug  6 21:05 6.dat
-rw-r--r-- 1 root root     9187968 Aug  6 21:05 6.idx
-r--r--r-- 1 root root 34373793480 Aug  6 21:05 7.dat
-rw-r--r-- 1 root root     9194224 Aug  6 21:05 7.idx
-r--r--r-- 1 root root 34366125792 Aug  7 03:42 8.dat
-rw-r--r-- 1 root root    12773360 Aug  7 03:42 8.idx
-r--r--r-- 1 root root 34373863544 Aug  7 03:42 9.dat
-rw-r--r-- 1 root root    12784896 Aug  7 03:42 9.idx

Original comment by Michalsk...@gmail.com on 12 Aug 2013 at 9:29

[GoogleCodeExporter]

OK. I checked in a fix to v 0.39. Please check that out.

If problem still happens, add "-v=4" between "weed volume" command and send me 
the console output. For example
 weed -v=4 volume -dir="/cdn/data2" -max=10 -mserver="localhost:9333" -port=8081

Original comment by chris...@gmail.com on 13 Aug 2013 at 12:01

[GoogleCodeExporter]

user@ip-machine:/home/user# I0813 08:57:16 31800 sequence.go:44] Loading file 
id sequence 28590000 => 28600000
I0813 08:57:16 31800 topology.go:58] Using default configurations.
I0813 08:57:16 31800 master.go:211] Volume Size Limit is 32768 MB
I0813 08:57:16 31800 master.go:225] Start Weed Master 0.39 at port 9333

user@ip-machine:/home/user# weed -v=4 volume -dir="/cdn/data1" -max=10 
-mserver="localhost:9333" -port=8080 &
[2] 31807
user@ip-machine:/home/user# I0813 08:57:26 31807 volume.go:329] Volume Folder 
/cdn/data1
I0813 08:57:26 31807 volume.go:330] Permission: -rwxr-xr-x
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/1.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/1.idx readonly false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 1 
replicationType = 000 version = 2 size = 34373857712
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/12.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/12.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 12 
replicationType = 000 version = 2 size = 34379298472
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/13.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/13.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 13 
replicationType = 000 version = 2 size = 34376306464
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/14.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/14.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 14 
replicationType = 000 version = 2 size = 34379419456
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/2.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/2.idx readonly false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 2 
replicationType = 000 version = 2 size = 34373909984
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/22.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/22.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 22 
replicationType = 000 version = 2 size = 3125153776
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/31.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/31.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 31 
replicationType = 000 version = 2 size = 3121307640
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/32.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/32.idx readonly 
false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 32 
replicationType = 000 version = 2 size = 3104083952
I0813 08:57:26 31807 volume.go:109] open to write file /cdn/data1/5.idx
I0813 08:57:26 31807 volume.go:115] loading file /cdn/data1/5.idx readonly false
I0813 08:57:26 31807 store.go:166] In dir /cdn/data1 read volume = 5 
replicationType = 000 version = 2 size = 34368039456
I0813 08:57:26 31807 store.go:173] Store started on dir: /cdn/data1 with 9 
volumes max 10
I0813 08:57:26 31807 volume.go:368] store joined at localhost:9333
I0813 08:57:26 31807 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8080
I0813 08:57:26 31800 node.go:158] topo adds child DefaultDataCenter
I0813 08:57:26 31800 node.go:158] topo:DefaultDataCenter adds child DefaultRack
I0813 08:57:26 31800 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8080
I0813 08:57:26 31800 topology.go:105] adding replication type 000

user@ip-machine:/home/user# weed -v=4 volume -dir="/cdn/data2" -max=10 
-mserver="localhost:9333" -port=8081 &
[3] 31818
user@ip-machine:/home/user# I0813 08:57:44 31818 volume.go:329] Volume Folder 
/cdn/data2
I0813 08:57:44 31818 volume.go:330] Permission: -rwxr-xr-x
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/10.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/10.idx readonly 
false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 10 
replicationType = 000 version = 2 size = 34379380944
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/11.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/11.idx readonly 
false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 11 
replicationType = 000 version = 2 size = 34379470048
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/19.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/19.idx readonly 
false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 19 
replicationType = 000 version = 2 size = 34374302952
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/26.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/26.idx readonly 
false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 26 
replicationType = 000 version = 2 size = 3102736384
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/3.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/3.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 3 
replicationType = 000 version = 2 size = 34373888840
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/4.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/4.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 4 
replicationType = 000 version = 2 size = 34373828840
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/6.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/6.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 6 
replicationType = 000 version = 2 size = 34373936336
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/7.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/7.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 7 
replicationType = 000 version = 2 size = 34373793480
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/8.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/8.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 8 
replicationType = 000 version = 2 size = 34366125792
I0813 08:57:44 31818 volume.go:109] open to write file /cdn/data2/9.idx
I0813 08:57:44 31818 volume.go:115] loading file /cdn/data2/9.idx readonly false
I0813 08:57:44 31818 store.go:166] In dir /cdn/data2 read volume = 9 
replicationType = 000 version = 2 size = 34373863544
I0813 08:57:44 31818 store.go:173] Store started on dir: /cdn/data2 with 10 
volumes max 10
I0813 08:57:44 31818 volume.go:368] store joined at localhost:9333
I0813 08:57:44 31818 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8081
I0813 08:57:44 31800 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8081

user@ip-machine:/home/user# weed -v=4 volume -dir="/cdn2/data3" -max=10 
-mserver="localhost:9333" -port=8082 &
[4] 31829
user@ip-machine:/home/user# I0813 08:57:55 31829 volume.go:329] Volume Folder 
/cdn2/data3
I0813 08:57:55 31829 volume.go:330] Permission: -rwxr-xr-x
I0813 08:57:55 31829 volume.go:109] open to write file /cdn2/data3/15.idx
I0813 08:57:55 31829 volume.go:115] loading file /cdn2/data3/15.idx readonly 
false
I0813 08:57:55 31829 store.go:166] In dir /cdn2/data3 read volume = 15 
replicationType = 000 version = 2 size = 34374398696
I0813 08:57:55 31829 volume.go:109] open to write file /cdn2/data3/16.idx
I0813 08:57:55 31829 volume.go:115] loading file /cdn2/data3/16.idx readonly 
false
I0813 08:57:55 31829 store.go:166] In dir /cdn2/data3 read volume = 16 
replicationType = 000 version = 2 size = 34367703400
I0813 08:57:55 31829 volume.go:109] open to write file /cdn2/data3/18.idx
I0813 08:57:55 31829 volume.go:115] loading file /cdn2/data3/18.idx readonly 
false
I0813 08:57:55 31829 store.go:166] In dir /cdn2/data3 read volume = 18 
replicationType = 000 version = 2 size = 34374370672
I0813 08:57:55 31829 volume.go:109] open to write file /cdn2/data3/20.idx
I0813 08:57:55 31829 volume.go:115] loading file /cdn2/data3/20.idx readonly 
false
I0813 08:57:55 31829 store.go:166] In dir /cdn2/data3 read volume = 20 
replicationType = 000 version = 2 size = 34368368992
I0813 08:57:55 31829 volume.go:109] open to write file /cdn2/data3/23.idx
I0813 08:57:55 31829 volume.go:115] loading file /cdn2/data3/23.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 23 
replicationType = 000 version = 2 size = 34364647712
I0813 08:57:56 31829 volume.go:109] open to write file /cdn2/data3/24.idx
I0813 08:57:56 31829 volume.go:115] loading file /cdn2/data3/24.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 24 
replicationType = 000 version = 2 size = 34362463112
I0813 08:57:56 31829 volume.go:109] open to write file /cdn2/data3/27.idx
I0813 08:57:56 31829 volume.go:115] loading file /cdn2/data3/27.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 27 
replicationType = 000 version = 2 size = 34367290096
I0813 08:57:56 31829 volume.go:109] open to write file /cdn2/data3/30.idx
I0813 08:57:56 31829 volume.go:115] loading file /cdn2/data3/30.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 30 
replicationType = 000 version = 2 size = 34364516552
I0813 08:57:56 31829 volume.go:109] open to write file /cdn2/data3/35.idx
I0813 08:57:56 31829 volume.go:115] loading file /cdn2/data3/35.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 35 
replicationType = 000 version = 2 size = 34364870832
I0813 08:57:56 31829 volume.go:109] open to write file /cdn2/data3/36.idx
I0813 08:57:56 31829 volume.go:115] loading file /cdn2/data3/36.idx readonly 
false
I0813 08:57:56 31829 store.go:166] In dir /cdn2/data3 read volume = 36 
replicationType = 000 version = 2 size = 34370903584
I0813 08:57:56 31829 store.go:173] Store started on dir: /cdn2/data3 with 10 
volumes max 10
I0813 08:57:56 31829 volume.go:368] store joined at localhost:9333
I0813 08:57:56 31829 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8082
I0813 08:57:56 31800 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8082

user@ip-machine:/home/user# weed -v=4 volume -dir="/cdn2/data4" -max=10 
-mserver="localhost:9333" -port=8083 &
[5] 31840
user@ip-machine:/home/user# I0813 08:58:08 31840 volume.go:329] Volume Folder 
/cdn2/data4
I0813 08:58:08 31840 volume.go:330] Permission: -rwxr-xr-x
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/17.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/17.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 17 
replicationType = 000 version = 2 size = 34374402624
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/21.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/21.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 21 
replicationType = 000 version = 2 size = 34374279704
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/25.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/25.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 25 
replicationType = 000 version = 2 size = 34365393376
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/29.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/29.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 29 
replicationType = 000 version = 2 size = 34365086648
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/33.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/33.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 33 
replicationType = 000 version = 2 size = 34365254056
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/34.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/34.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 34 
replicationType = 000 version = 2 size = 34366156312
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/37.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/37.idx readonly 
false
I0813 08:58:08 31840 store.go:166] In dir /cdn2/data4 read volume = 37 
replicationType = 000 version = 2 size = 34367088872
I0813 08:58:08 31840 volume.go:109] open to write file /cdn2/data4/38.idx
I0813 08:58:08 31840 volume.go:115] loading file /cdn2/data4/38.idx readonly 
false
I0813 08:58:09 31840 store.go:166] In dir /cdn2/data4 read volume = 38 
replicationType = 000 version = 2 size = 34364223432
I0813 08:58:09 31840 volume.go:109] open to write file /cdn2/data4/39.idx
I0813 08:58:09 31840 volume.go:115] loading file /cdn2/data4/39.idx readonly 
false
I0813 08:58:09 31840 store.go:166] In dir /cdn2/data4 read volume = 39 
replicationType = 000 version = 2 size = 34361510000
I0813 08:58:09 31840 volume.go:109] open to write file /cdn2/data4/40.idx
I0813 08:58:09 31840 volume.go:115] loading file /cdn2/data4/40.idx readonly 
false
I0813 08:58:09 31840 store.go:166] In dir /cdn2/data4 read volume = 40 
replicationType = 000 version = 2 size = 34368824216
I0813 08:58:09 31840 store.go:173] Store started on dir: /cdn2/data4 with 10 
volumes max 10
I0813 08:58:09 31840 volume.go:368] store joined at localhost:9333
I0813 08:58:09 31840 volume.go:370] Start Weed volume server 0.39 at 
http://localhost:8083
I0813 08:58:09 31800 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8083

user@ip-machine:/home/user# curl http://localhost:8080/status?pretty=y
{
  "Version": "0.39",
  "Volumes": [
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}user@ip-machine:/home/user# curl http://localhost:8081/status?pretty=y
{
  "Version": "0.39",
  "Volumes": [
    {
      "Id": 10,
      "Size": 34359793194,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799394,
      "DeleteCount": 388,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 19,
      "Size": 34359781079,
      "RepType": "000",
      "Version": 2,
      "FileCount": 593384,
      "DeleteCount": 553,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 6,
      "Size": 34359903513,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574248,
      "DeleteCount": 7,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 8,
      "Size": 34346565473,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798335,
      "DeleteCount": 360,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 11,
      "Size": 34359896499,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798817,
      "DeleteCount": 383,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 26,
      "Size": 3101470041,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51846,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 3,
      "Size": 34359837177,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575128,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 4,
      "Size": 34359790973,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574601,
      "DeleteCount": 13,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 7,
      "Size": 34359751291,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574639,
      "DeleteCount": 16,
      "DeletedByteCount": 0,
      "ReadOnly": false
    },
    {
      "Id": 9,
      "Size": 34354286636,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799056,
      "DeleteCount": 369,
      "DeletedByteCount": 0,
      "ReadOnly": false
    }
  ]
}user@ip-machine:/home/user# curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": 1,
        "Max": 40,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": 1,
                "Max": 10,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8082",
                "Url": "localhost:8082",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              }
            ],
            "Free": 1,
            "Max": 40
          }
        ]
      }
    ],
    "Free": 1,
    "Max": 40,
    "layouts": [
      {
        "replication": "000",
        "writables": [
          22,
          32,
          31,
          26
        ]
      }
    ]
  },
  "Version": "0.39"
}

Original comment by Michalsk...@gmail.com on 13 Aug 2013 at 9:00

[GoogleCodeExporter]

I see. Please use v0.40. And if the problem still happens, please collect the 
same information.

Also, what's your underlying file system? ZFS, Fat32, etc? Seems it can open a 
read only file in read-write mode without any exception. You can run "df -T" to 
check it.

Original comment by chris...@gmail.com on 13 Aug 2013 at 4:15

[GoogleCodeExporter]

Filesystem     Type      1K-blocks      Used Available Use% Mounted on
/dev/xvda1     ext4      154818540  37793424 109162616  26% /
udev           devtmpfs   15371880         8  15371872   1% /dev
tmpfs          tmpfs       6151996       188   6151808   1% /run
none           tmpfs          5120         0      5120   0% /run/lock
none           tmpfs      15379984         0  15379984   0% /run/shm
/dev/xvdf      ext4      516061624 516061624         0 100% /cdn
/dev/xvdg      ext4     1056894132 288576648 714630396  29% /sources
/dev/xvdh      ext4     1056894132 671639584 331567460  67% /cdn2

Will install the 0.4 now

Original comment by Michalsk...@gmail.com on 13 Aug 2013 at 4:43

[GoogleCodeExporter]

Worked ! Thanks a lot !

user@ip-machine:/home/user/0.40# I0813 16:44:07 32381 sequence.go:44] Loading 
file id sequence 28590000 => 28600000
I0813 16:44:07 32381 topology.go:58] Using default configurations.
I0813 16:44:07 32381 master.go:211] Volume Size Limit is 32768 MB
I0813 16:44:07 32381 master.go:225] Start Weed Master 0.40 at port 9333

user@ip-machine:/home/user/0.40# weed -v=4 volume -dir="/cdn/data1" -max=10 
-mserver="localhost:9333" -port=8080 &
[2] 32388
user@ip-machine:/home/user/0.40# I0813 16:44:14 32388 volume.go:332] Volume 
Folder /cdn/data1
I0813 16:44:14 32388 volume.go:333] Permission: -rwxr-xr-x
I0813 16:44:14 32388 volume.go:63] opening /cdn/data1/1.dat in READONLY mode
I0813 16:44:14 32388 volume.go:87] open to read file /cdn/data1/1.idx
I0813 16:44:14 32388 volume.go:97] loading file /cdn/data1/1.idx readonly true
I0813 16:44:14 32388 store.go:166] In dir /cdn/data1 read volume = 1 
replicationType = 000 version = 2 size = 34373857712
I0813 16:44:14 32388 volume.go:63] opening /cdn/data1/12.dat in READONLY mode
I0813 16:44:14 32388 volume.go:87] open to read file /cdn/data1/12.idx
I0813 16:44:14 32388 volume.go:97] loading file /cdn/data1/12.idx readonly true
I0813 16:44:14 32388 store.go:166] In dir /cdn/data1 read volume = 12 
replicationType = 000 version = 2 size = 34379298472
I0813 16:44:14 32388 volume.go:63] opening /cdn/data1/13.dat in READONLY mode
I0813 16:44:14 32388 volume.go:87] open to read file /cdn/data1/13.idx
I0813 16:44:14 32388 volume.go:97] loading file /cdn/data1/13.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 13 
replicationType = 000 version = 2 size = 34376306464
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/14.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/14.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/14.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 14 
replicationType = 000 version = 2 size = 34379419456
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/2.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/2.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/2.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 2 
replicationType = 000 version = 2 size = 34373909984
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/22.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/22.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/22.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 22 
replicationType = 000 version = 2 size = 3125153776
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/28.dat in READONLY mode
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/31.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/31.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/31.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 31 
replicationType = 000 version = 2 size = 3121307640
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/32.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/32.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/32.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 32 
replicationType = 000 version = 2 size = 3104083952
I0813 16:44:15 32388 volume.go:63] opening /cdn/data1/5.dat in READONLY mode
I0813 16:44:15 32388 volume.go:87] open to read file /cdn/data1/5.idx
I0813 16:44:15 32388 volume.go:97] loading file /cdn/data1/5.idx readonly true
I0813 16:44:15 32388 store.go:166] In dir /cdn/data1 read volume = 5 
replicationType = 000 version = 2 size = 34368039456
I0813 16:44:15 32388 store.go:173] Store started on dir: /cdn/data1 with 9 
volumes max 10
I0813 16:44:15 32388 volume.go:374] store joined at localhost:9333
I0813 16:44:15 32388 volume.go:376] Start Weed volume server 0.40 at 
http://localhost:8080
I0813 16:44:15 32381 node.go:158] topo adds child DefaultDataCenter
I0813 16:44:15 32381 node.go:158] topo:DefaultDataCenter adds child DefaultRack
I0813 16:44:15 32381 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8080
I0813 16:44:15 32381 topology.go:105] adding replication type 000

user@ip-machine:/home/user/0.40# weed -v=4 volume -dir="/cdn/data2" -max=10 
-mserver="localhost:9333" -port=8081 &
[3] 32399
user@ip-machine:/home/user/0.40# I0813 16:44:26 32399 volume.go:332] Volume 
Folder /cdn/data2
I0813 16:44:26 32399 volume.go:333] Permission: -rwxr-xr-x
I0813 16:44:26 32399 volume.go:63] opening /cdn/data2/10.dat in READONLY mode
I0813 16:44:26 32399 volume.go:87] open to read file /cdn/data2/10.idx
I0813 16:44:26 32399 volume.go:97] loading file /cdn/data2/10.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 10 
replicationType = 000 version = 2 size = 34379380944
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/11.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/11.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/11.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 11 
replicationType = 000 version = 2 size = 34379470048
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/19.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/19.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/19.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 19 
replicationType = 000 version = 2 size = 34374302952
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/26.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/26.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/26.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 26 
replicationType = 000 version = 2 size = 3102736384
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/3.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/3.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/3.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 3 
replicationType = 000 version = 2 size = 34373888840
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/4.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/4.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/4.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 4 
replicationType = 000 version = 2 size = 34373828840
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/6.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/6.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/6.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 6 
replicationType = 000 version = 2 size = 34373936336
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/7.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/7.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/7.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 7 
replicationType = 000 version = 2 size = 34373793480
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/8.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/8.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/8.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 8 
replicationType = 000 version = 2 size = 34366125792
I0813 16:44:27 32399 volume.go:63] opening /cdn/data2/9.dat in READONLY mode
I0813 16:44:27 32399 volume.go:87] open to read file /cdn/data2/9.idx
I0813 16:44:27 32399 volume.go:97] loading file /cdn/data2/9.idx readonly true
I0813 16:44:27 32399 store.go:166] In dir /cdn/data2 read volume = 9 
replicationType = 000 version = 2 size = 34373863544
I0813 16:44:27 32399 store.go:173] Store started on dir: /cdn/data2 with 10 
volumes max 10
I0813 16:44:27 32399 volume.go:374] store joined at localhost:9333
I0813 16:44:27 32399 volume.go:376] Start Weed volume server 0.40 at 
http://localhost:8081
I0813 16:44:27 32381 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8081

user@ip-machine:/home/user/0.40# weed -v=4 volume -dir="/cdn2/data3" -max=10 
-mserver="localhost:9333" -port=8082 &
[4] 32410
user@ip-machine:/home/user/0.40# I0813 16:44:33 32410 volume.go:332] Volume 
Folder /cdn2/data3
I0813 16:44:33 32410 volume.go:333] Permission: -rwxr-xr-x
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/15.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/15.idx readonly 
false
I0813 16:44:33 32410 store.go:166] In dir /cdn2/data3 read volume = 15 
replicationType = 000 version = 2 size = 34374398696
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/16.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/16.idx readonly 
false
I0813 16:44:33 32410 store.go:166] In dir /cdn2/data3 read volume = 16 
replicationType = 000 version = 2 size = 34367703400
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/18.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/18.idx readonly 
false
I0813 16:44:33 32410 store.go:166] In dir /cdn2/data3 read volume = 18 
replicationType = 000 version = 2 size = 34374370672
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/20.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/20.idx readonly 
false
I0813 16:44:33 32410 store.go:166] In dir /cdn2/data3 read volume = 20 
replicationType = 000 version = 2 size = 34368368992
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/23.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/23.idx readonly 
false
I0813 16:44:33 32410 store.go:166] In dir /cdn2/data3 read volume = 23 
replicationType = 000 version = 2 size = 34364647712
I0813 16:44:33 32410 volume.go:92] open to write file /cdn2/data3/24.idx
I0813 16:44:33 32410 volume.go:97] loading file /cdn2/data3/24.idx readonly 
false
I0813 16:44:34 32410 store.go:166] In dir /cdn2/data3 read volume = 24 
replicationType = 000 version = 2 size = 34362463112
I0813 16:44:34 32410 volume.go:92] open to write file /cdn2/data3/27.idx
I0813 16:44:34 32410 volume.go:97] loading file /cdn2/data3/27.idx readonly 
false
I0813 16:44:34 32410 store.go:166] In dir /cdn2/data3 read volume = 27 
replicationType = 000 version = 2 size = 34367290096
I0813 16:44:34 32410 volume.go:92] open to write file /cdn2/data3/30.idx
I0813 16:44:34 32410 volume.go:97] loading file /cdn2/data3/30.idx readonly 
false
I0813 16:44:34 32410 store.go:166] In dir /cdn2/data3 read volume = 30 
replicationType = 000 version = 2 size = 34364516552
I0813 16:44:34 32410 volume.go:92] open to write file /cdn2/data3/35.idx
I0813 16:44:34 32410 volume.go:97] loading file /cdn2/data3/35.idx readonly 
false
I0813 16:44:34 32410 store.go:166] In dir /cdn2/data3 read volume = 35 
replicationType = 000 version = 2 size = 34364870832
I0813 16:44:34 32410 volume.go:92] open to write file /cdn2/data3/36.idx
I0813 16:44:34 32410 volume.go:97] loading file /cdn2/data3/36.idx readonly 
false
I0813 16:44:34 32410 store.go:166] In dir /cdn2/data3 read volume = 36 
replicationType = 000 version = 2 size = 34370903584
I0813 16:44:34 32410 store.go:173] Store started on dir: /cdn2/data3 with 10 
volumes max 10
I0813 16:44:34 32410 volume.go:374] store joined at localhost:9333
I0813 16:44:34 32410 volume.go:376] Start Weed volume server 0.40 at 
http://localhost:8082
I0813 16:44:34 32381 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8082

user@ip-machine:/home/user/0.40# weed -v=4 volume -dir="/cdn2/data4" -max=10 
-mserver="localhost:9333" -port=8083 &
[5] 32421
user@ip-machine:/home/user/0.40# I0813 16:44:42 32421 volume.go:332] Volume 
Folder /cdn2/data4
I0813 16:44:42 32421 volume.go:333] Permission: -rwxr-xr-x
I0813 16:44:42 32421 volume.go:92] open to write file /cdn2/data4/17.idx
I0813 16:44:42 32421 volume.go:97] loading file /cdn2/data4/17.idx readonly 
false
I0813 16:44:42 32421 store.go:166] In dir /cdn2/data4 read volume = 17 
replicationType = 000 version = 2 size = 34374402624
I0813 16:44:42 32421 volume.go:92] open to write file /cdn2/data4/21.idx
I0813 16:44:42 32421 volume.go:97] loading file /cdn2/data4/21.idx readonly 
false
I0813 16:44:42 32421 store.go:166] In dir /cdn2/data4 read volume = 21 
replicationType = 000 version = 2 size = 34374279704
I0813 16:44:42 32421 volume.go:92] open to write file /cdn2/data4/25.idx
I0813 16:44:42 32421 volume.go:97] loading file /cdn2/data4/25.idx readonly 
false
I0813 16:44:42 32421 store.go:166] In dir /cdn2/data4 read volume = 25 
replicationType = 000 version = 2 size = 34365393376
I0813 16:44:42 32421 volume.go:92] open to write file /cdn2/data4/29.idx
I0813 16:44:42 32421 volume.go:97] loading file /cdn2/data4/29.idx readonly 
false
I0813 16:44:42 32421 store.go:166] In dir /cdn2/data4 read volume = 29 
replicationType = 000 version = 2 size = 34365086648
I0813 16:44:42 32421 volume.go:92] open to write file /cdn2/data4/33.idx
I0813 16:44:42 32421 volume.go:97] loading file /cdn2/data4/33.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 33 
replicationType = 000 version = 2 size = 34365254056
I0813 16:44:43 32421 volume.go:92] open to write file /cdn2/data4/34.idx
I0813 16:44:43 32421 volume.go:97] loading file /cdn2/data4/34.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 34 
replicationType = 000 version = 2 size = 34366156312
I0813 16:44:43 32421 volume.go:92] open to write file /cdn2/data4/37.idx
I0813 16:44:43 32421 volume.go:97] loading file /cdn2/data4/37.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 37 
replicationType = 000 version = 2 size = 34367088872
I0813 16:44:43 32421 volume.go:92] open to write file /cdn2/data4/38.idx
I0813 16:44:43 32421 volume.go:97] loading file /cdn2/data4/38.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 38 
replicationType = 000 version = 2 size = 34364223432
I0813 16:44:43 32421 volume.go:92] open to write file /cdn2/data4/39.idx
I0813 16:44:43 32421 volume.go:97] loading file /cdn2/data4/39.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 39 
replicationType = 000 version = 2 size = 34361510000
I0813 16:44:43 32421 volume.go:92] open to write file /cdn2/data4/40.idx
I0813 16:44:43 32421 volume.go:97] loading file /cdn2/data4/40.idx readonly 
false
I0813 16:44:43 32421 store.go:166] In dir /cdn2/data4 read volume = 40 
replicationType = 000 version = 2 size = 34368824216
I0813 16:44:43 32421 store.go:173] Store started on dir: /cdn2/data4 with 10 
volumes max 10
I0813 16:44:43 32421 volume.go:374] store joined at localhost:9333
I0813 16:44:43 32421 volume.go:376] Start Weed volume server 0.40 at 
http://localhost:8083
I0813 16:44:43 32381 node.go:158] topo:DefaultDataCenter:DefaultRack adds child 
localhost:8083

curl http://localhost:8080/status?pretty=y
{
  "Version": "0.40",
  "Volumes": [
    {
      "Id": 12,
      "Size": 34359746239,
      "RepType": "000",
      "Version": 2,
      "FileCount": 797790,
      "DeleteCount": 364,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 13,
      "Size": 34356740008,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798799,
      "DeleteCount": 355,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 32,
      "Size": 3102823452,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51552,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 5,
      "Size": 34353994095,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574945,
      "DeleteCount": 14,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 1,
      "Size": 34359804852,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575162,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 14,
      "Size": 34359817226,
      "RepType": "000",
      "Version": 2,
      "FileCount": 800142,
      "DeleteCount": 399,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 2,
      "Size": 34359857209,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575130,
      "DeleteCount": 17,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 22,
      "Size": 3123880148,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52116,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 31,
      "Size": 3120027327,
      "RepType": "000",
      "Version": 2,
      "FileCount": 52406,
      "DeleteCount": 61,
      "DeletedByteCount": 0,
      "ReadOnly": true
    }
  ]
}user@ip-machine:/home/user/0.40# curl http://localhost:8081/status?pretty=y
{
  "Version": "0.40",
  "Volumes": [
    {
      "Id": 11,
      "Size": 34359896499,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798817,
      "DeleteCount": 383,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 19,
      "Size": 34359781079,
      "RepType": "000",
      "Version": 2,
      "FileCount": 593384,
      "DeleteCount": 553,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 9,
      "Size": 34354286636,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799056,
      "DeleteCount": 369,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 10,
      "Size": 34359793194,
      "RepType": "000",
      "Version": 2,
      "FileCount": 799394,
      "DeleteCount": 388,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 26,
      "Size": 3101470041,
      "RepType": "000",
      "Version": 2,
      "FileCount": 51846,
      "DeleteCount": 78,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 3,
      "Size": 34359837177,
      "RepType": "000",
      "Version": 2,
      "FileCount": 575128,
      "DeleteCount": 21,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 4,
      "Size": 34359790973,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574601,
      "DeleteCount": 13,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 6,
      "Size": 34359903513,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574248,
      "DeleteCount": 7,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 7,
      "Size": 34359751291,
      "RepType": "000",
      "Version": 2,
      "FileCount": 574639,
      "DeleteCount": 16,
      "DeletedByteCount": 0,
      "ReadOnly": true
    },
    {
      "Id": 8,
      "Size": 34346565473,
      "RepType": "000",
      "Version": 2,
      "FileCount": 798335,
      "DeleteCount": 360,
      "DeletedByteCount": 0,
      "ReadOnly": true
    }
  ]
}user@ip-machine:/home/user/0.40# curl http://localhost:9333/dir/status?pretty=y
{
  "Topology": {
    "DataCenters": [
      {
        "Free": 1,
        "Max": 40,
        "Racks": [
          {
            "DataNodes": [
              {
                "Free": 1,
                "Max": 10,
                "PublicUrl": "localhost:8080",
                "Url": "localhost:8080",
                "Volumes": 9
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8081",
                "Url": "localhost:8081",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8082",
                "Url": "localhost:8082",
                "Volumes": 10
              },
              {
                "Free": 0,
                "Max": 10,
                "PublicUrl": "localhost:8083",
                "Url": "localhost:8083",
                "Volumes": 10
              }
            ],
            "Free": 1,
            "Max": 40
          }
        ]
      }
    ],
    "Free": 1,
    "Max": 40,
    "layouts": [
      {
        "replication": "000",
        "writables": null
      }
    ]
  },
  "Version": "0.40"
}

Original comment by Michalsk...@gmail.com on 13 Aug 2013 at 4:48

[GoogleCodeExporter]

Thanks for all the details!

Original comment by chris...@gmail.com on 14 Aug 2013 at 7:34

• Changed state: Verified