jayzeng scrapy-elasticsearch issues

jayzeng / scrapy-elasticsearch

A scrapy pipeline which send items to Elastic Search server

327 stars 88 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Fix: support for scrapy's dataclass item

#95 ghost closed 1 year ago
0
Doesn't support scrapy dataclass item

#94 ghost opened 2 years ago
0
elasticsearch.helpers.BulkIndexError after long time of scraping

#93 SuperMasterBlasterLaser closed 2 years ago
5
Cluster name and Cluster node field not available

#92 SaksheePhade opened 3 years ago
0
I downloaded the package but I still get a module not found.

#91 ebubekirbbr opened 3 years ago
0
Support ES7 typeless API

#90 junmasui closed 2 years ago
1
Add support to create index with mapping definition

#89 andersoncarubelli closed 4 days ago
0
Please support Scrapy 2.4.1

#88 videni opened 3 years ago
1
ElasticsearchDeprecationWarning: [types removal] Specifying types in bulk requests is deprecated.

#87 srinivas365 opened 3 years ago
0
Suggestion of setting '_index', '_source' and other parameters directly in parser

#86 julfes opened 4 years ago
0
Added possibility to use api-key for authentification.

#85 julfes opened 4 years ago
0
deleted

#84 misterch0c closed 4 years ago
0
Scrapy logging show UnicodeDecodeError

#83 isamzwuairi opened 4 years ago
1
Add option to save documents by merging them with existing ones

#82 diegov opened 4 years ago
0
Suggest making item_id = hashlib.sha1(unique_key).hexdigest() optional

#81 getorca opened 4 years ago
0
is it possible update item if this item with id exists?

#80 heilwood opened 4 years ago
2
got an unexpected keyword argument 'headers'

#79 llermaly opened 6 years ago
3
Missing header information for ElasticSearch 6.2

#78 nerdstein opened 6 years ago
2
BulkIndexError

#77 abc16810 closed 5 years ago
1
Removal of _type requirement

#76 powerinva opened 6 years ago
0
Unique key is tuple if using items

#75 sorenjacobi closed 5 years ago
1
Fix typo in Readme

#74 julien-duponchelle closed 6 years ago
1
Text field always gets ignore_above keyword

#73 tomasn4a closed 5 years ago
1
Add index_type from a field in the item

#72 aleroot opened 7 years ago
8
Add support for field based index splitting

#71 dameyerdave opened 7 years ago
2
Allow composite key inside ELASTICSEARCH_UNIQ_KEY

#70 aleroot closed 7 years ago
1
Content-Type required, Elasticsearch 6.x

#69 sebz1504 closed 7 years ago
1
Custom ca

#68 jayzeng closed 7 years ago
0
Unable to post to ssl endpoint with custom CA

#67 LordBrain closed 7 years ago
7
What does 'ELASTICSEARCH_UNIQ_KEY' do?

#66 Feelthewind closed 7 years ago
2
Move ID generation to separate method

#65 alukach closed 7 years ago
1
Elasticsearch not receiving data from scrapy

#64 harakiri406 closed 7 years ago
4
Pipeline sending data after spider_closed and opened again.

#63 ghost closed 7 years ago
3
ELASTICSEARCH_BUFFER_LENGTH

#62 ghost closed 7 years ago
2
Elasticsearch 5 has maybe more reason to allow the creation of mapping

#61 kootenpv opened 7 years ago
1
flush/commit every ELASTICSEARCH_FLUSH_SIZE items, and flush at end.

#60 danizen closed 7 years ago
2
Lots of items missing in kibana when using elasticsearch pipeline, but available in csv export and another relational pipeline

#59 msdos closed 7 years ago
6
Ability to specify ingest pipeline as a query parameter

#58 dbuijs opened 7 years ago
2
Elasticsearch pipeline not enabled - Scrapy 1.3.3 / ES 5.2

#57 Beenhakker closed 7 years ago
6
Specifiy specific fields to index

#56 maanas closed 7 years ago
3
[SUGGESTION] Tackling MemoryError raised on bulk inserts

#55 eventuallyc0nsistent closed 7 years ago
2
Location of scrapyelasticsearch.py file

#54 punit07 closed 7 years ago
2
Delete data from ES index before inserting data again ?

#53 punit07 closed 7 years ago
3
How to insert data into an existing index ?

#52 punit07 closed 7 years ago
4
add index mapping

#51 dijadev opened 8 years ago
5
Fix: str key was never encoded in utf-8.

#50 PPACI closed 8 years ago
1
ElasticSearch on AWS

#49 philippbussche opened 8 years ago
1
Two new parameters: ELASTICSEARCH_INDEX_DATE_KEY and ELASTICSEARCH_INDEX_DATE_KEY_FORMAT

#48 jenkin closed 7 years ago
0
Ntlm optional

#47 jayzeng closed 8 years ago
0
How to handle deleted documents?

#46 burnash closed 8 years ago
4