rtarway ecommerce-streamlytics-clickstream2 issues

rtarway / ecommerce-streamlytics-clickstream2

0 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

pull from beamlytics to rtarwya

#30 rtarway closed 6 months ago
0
check the data type for this field, should be timestamp

#29 rtarway opened 6 months ago
0
convert to a service which requires a few hundred ms to respond.

#28 rtarway opened 6 months ago
0
convert to a service which requires a few hundred ms to respond.

#27 rtarway opened 6 months ago
0
: remove all Experimental annotation once verified that its working fine and no-longer experiement

#26 rtarway opened 8 months ago
0
: Modify transaction schema to add type of transaction from event hub:

#25 rtarway opened 8 months ago
0
: Filter transactions to calculate availability, rest should be written to bigquery only for analytical purposes

#24 rtarway opened 8 months ago
0
Add an attribute by calculating availability as "total supply - total demand"

#23 rtarway opened 8 months ago
0
Add an attribute by projecting future availability by date

#22 rtarway opened 8 months ago
0
investigate why PDone here would cause a test hang.

#21 rtarway opened 8 months ago
0
remove hard coded attribute names if we allow integration with various systems

#20 rtarway opened 8 months ago
0
This should never be Null eliminate bug.

#19 rtarway opened 8 months ago
0
the schema registry for PageViewAggregator throws a class cast issue

#18 rtarway opened 8 months ago
0
Need a more detailed function for item validation, probably as an UserExit so that we can customize as needed

#17 rtarway opened 8 months ago
0
get lat & lng from table once the data supports it.

#16 rtarway opened 8 months ago
0
convert to a service which requires a few hundred ms to respond.

#15 rtarway opened 8 months ago
0
remove hardcoded seconds

#14 rtarway opened 8 months ago
0
remove hardcoded seconds in counting inventory

#13 rtarway opened 8 months ago
0
remove hardcoded seconds

#12 rtarway opened 8 months ago
0
remove the hardcoding of 10 seconds and paramterize it

#11 rtarway opened 8 months ago
0
need to partition the bigquery table on timestamp or start time

#10 rtarway opened 8 months ago
0
: remove hardcoded fixed duration of 5 sec, also this duration needs to be lower for ecommerce env. We need to test with different values and figure out minimal time system can support with varying number of worker nodes and capacities

#9 rtarway opened 8 months ago
0
: enable time partitioning on this table

#8 rtarway opened 8 months ago
0
We need to research how does this table get populated with data on first run? From code, it seems the table should be preloaded in bigquery? If it should be pre-loaded, then we need to create programs to do same.

#7 rtarway closed 6 months ago
0
WTF? The store is hardcoded to a single store? This definitely needs to come from a master data table which contains all store ids and corresponding location

#6 rtarway closed 8 months ago
1
this needs to be replaced by real store coming from transaction data. We can not have stores created artificically but we should design to create stores as it comes in feed.

#5 rtarway closed 8 months ago
1
explore how schema conversions can be overridden for logical types such as timestamps

#4 rtarway opened 8 months ago
0
Need to make sure that sessionlized data goes to time partitioned table in bigquery

#3 rtarway opened 8 months ago
0
: enable timestamp as partition, currently the schema defines it as long but it is not encoded as logical type of timestamp, rather string.

#2 rtarway opened 8 months ago
0
bigtable sink to save on costs during poc

#1 rtarway closed 6 months ago
0