Open bnaya-payoneer opened 1 month ago
Infra 1:
Eventbus
a. Improve stability )CPU issues, Redis timeouts)
b. NIFI replacement with Kafka connectors
c. Migrate Application events to Kafka – multi phase project (Migration plan should be with deadlines in the R&D)
d. Flink/flitering options – this will enable full support of application events migration, consumers improvement in general (will reduce the need in the eventbus rules + will benefit ISAPI)
e. Create guidelines for using Kafka/Rabbit/EB
f. AI Moti: Can we close Event bus for new events by default, and only open with approval – after verifying the actual needs and tech requirements.
Secret manager
a. Akeyless VS Vault decision
b. Migrate from Vendor credentials service to the new solution (cloud and main platform solution!)
FSS development
a. MUST decide if “Go Anywhere” or any other product with Ido Adam
b. Currently developing fairness feature
c. What is planned for phase 2 ?
d. Status:n18.7 – Phase1 - deployed to QA.
Parameters enforcement
a. The goal is to block direct DB updates on a shared table using API.
b. Currently blocked by devops portal development
c. AI Moti: check what is the cycle of snapshots for the parameters table, to allow a quick rollback.
Outbox Pattern
Future:
a. Need to check how we can increase consumers on Kafka topic above the number of partitions
b. Need to do a load test and see best practices for each platform
c. Need to establish guideline for usages
Infra 2:
Smart .NET 8+ Template
Log Standard – Finishing replacement
Open API NuGet – handover from Bnaya + fill TC
Future:
Infra 3:
ISAPI
Has many planned features in the backlog
The priority is to improve stability, reduce the data loss cases
Second priority – insert new data sources
Conductor
Deploy conductor service latest version to PROD
Automation process
DR solution – MUST have a war room at the end to confirm the success of the solution
Archiving improvements
ReportAPI – Data API
Has clear first phase in the backlog
The second phase is to create queries without a data engineer - Need to develop with Vadim the design and requirements
ODS – Mongo POC
Waiting for decisions – currently handled by Nir Agai. Missing clear deadlines and goals.
Future:
Take ownership – DMPS (no clear deadline- depends on the team ability to take the project)
Take ownership – Files API (no clear deadline- depends on the team ability to take the project)
Event Sourcing – based on Capacity + need to find users before developing!
General tasks for the group
Formulate the process
Define the roles
Set Expectations
[ ] Excellency ;-)
✗ Kanban
Main Features