Tribler / tribler

Privacy enhanced BitTorrent client with P2P content discovery
https://www.tribler.org
GNU General Public License v3.0
4.73k stars 445 forks source link

phd placeholder: identity, reputation, trust, something #6519

Open synctext opened 2 years ago

synctext commented 2 years ago

Phd track: 21 Nov 2021 - 21 Nov 2025 First step in 4 year phd track: get paper from master thesis work. Venues: https://github.com/Tribler/tribler/wiki/Scientific-publication-venues-for-ledger-science After first publication move beyond strong identity to a Repucoin or other Tribler-lab interest. Ideas like generalisation of IPv8 communities into "networking fabric for social intelligence", or beyond 1988 distributed file systems into the first self-organising global commons information space :rocket:

The graduate school needs a blurb of a possible phd description:

Big Tech dominates the Internet economy and forms a natural monopoly.
Alternatives based on non-profit approaches are needed, commonly called the
decentralised web. This thesis will produce innovations in the field of strong identity,
trust frameworks, self-organising systems, and commons-based leaderless
communities.

Publication options: the decentralised web storyline, see Mastodon article. co-next and IMC. Publication from almost 40 years ago about "managing the global commons", still unsolved. A big "reality gap" exists between the people that talk about sovereignty, public data commons and (darknet) technology which provides it. image

InvictusRMC commented 2 years ago

Progress update:

Next steps:

synctext commented 2 years ago

This thesis will produce innovations in the field of strong identity, trust frameworks, self-organising systems, and commons-based leaderless communities.

Ancient problems of freeriding and Sybils are unsolved. They have proven to be exceptionally hard, unsolved by Big Tech, and are now popping up in the latest hipster topics. After 20 years we now have a new context for "freeriding&Sybil research": Web3, decentralised web, and federated machine learning. Already in 2011 (!!!) the pioneering work by Márk Jelasity proved the viability of gossip-learning "Gossip Learning with Linear Models on Fully Distributed Data". This worked also showed that the P2P problems of freeriding and Sybils are still the same in federated machine learning context. Sample of recent work:

synctext commented 2 years ago

2021 related work: "Building a Sybil-Resilient Digital Community Utilizing Trust-Graph Connectivity" (covers all our ideas)

we explore the use of a trust-graph of identities, with edges
representing trust among identity owners, to allow a community
to grow indefinitely without increasing its sybil penetration.   [...]
Of particular interest is keeping the fraction of byzantines below
one third, as it would allow the use of Byzantine Agreement 
for consensus as well as for sybil-resilient social choice
(Shahaf et al., 2019). This paper considers incrementally growing
a trust graph and shows that, under its key assumptions and
additional requirements, including keeping the conductance or
vertex expansion of the community trust graph sufficiently high,
a community may grow safely, indefinitely.
synctext commented 2 years ago

Real-world trust and reputation laundering: https://restofworld.org/2022/documents-reputation-laundering-firm-eliminalia/ and the details: https://www.qurium.org/forensics/dark-ops-undercovered-episode-i-eliminalia/ HN discussion with more. 300 fake newspapers, fake DMCA, Google de-indexing attack, spoofing European Commission, etc Potential dataset partners?

```There are 17,000 URLs that were apparently targeted on clients’ behalf between 2015 and 2019.```
synctext commented 2 years ago

Related: User accounts are central to tracking people. Strong identity and web-of-trust are separate issues? Thoughts on future platform for experiments, superapp is less unique than I originally though. commercial competition around integrated instant-messaging, wallets and "web3 browsers". Trustworthy decentralised Google replacement has no known commercial competitor (or any significant academic initiative). Its hard to do a few phd thesis chapters for 3 years with commercials competitors also doing competing innovations.

synctext commented 2 years ago

brainstorm {problem: selling the engineering of a unique system is not deemed scientific by reviewers; acsos2022, 6may or taas} Our Web3 toolkit creates the critical infrastructure for identity,money,trust,data and AI. Our Web3 architecture is academically pure: it is 100% Big Tech free, does not use any third party, does not include a server, or single PC. Our Web3 stack only exists on edge devices. We demonstrate the strength of our Web3 stack with three examples:

synctext commented 2 years ago

Possible thesis focus with ideal publication prospects: "Adversarial Learn-to-rank in Web3: thriving while subject to relentless attacks"

Brainstorm: https://2022.acsos.org/track/acsos-2022-papers#About ``` Web3: a revival of Self-Organising Systems Our work is designed to specifically address the following gross defect in our current socio-economic systems: _the conservation of centralisation_ https://cacm.acm.org/magazines/2021/3/250710-the-decline-of-computers-as-a-general-purpose-technology/fulltext Within this article we outline how the distributed Web3 movement represents the renaissance of self-organising systems. We show operational technology with an as decentralised as possible architecture. Based on common smartphone hardware we demonstrate 1) how users can form a secure communication network; one which is extremely robust and does not require any server, laptop, or other coordinating device. Decentralisation also offers autonomy. {reformulate politics below into science-speak} Our core Web3 principle is that everything is owned by the people themselves, the direct ownership rule. Direct ownership is an inalienable right. You own your own data, your own identity, your own money, and your own means of production. Markets, states and megacorporations have no voice, no influence, and hold no power. All capital is directly owned, no central bank, commercial banks, or financial intermediaries exist. https://eriktorenberg.substack.com/p/software-is-eating-the-world-revisited?s=r Web3: replacing the first industry with software We present a self-organising system. The word 'politics' rarely appears in SASO proceedings. Empowering citizens to self-organise against monopolies is deep political.
synctext commented 2 years ago

DAO economics

We explore the fundamentals of Decentralised Autonomous Organisations to organise the global economy. Our DAO is run exclusively using code and governs itself. We present a generalised DAO architecture around identity, trust, money, data, markets, and AI. Our experimental work provides an operational economy which proves the viability of our DAO architecture. Unique quality is that no legal entity or world government holds any special power. We successfully realised the first DAO with an academically pure level of decentralisation, no centrality of any kind exists. Our DelftDAO is democratically organised based on the principle of self-governance. We as the original original founders have no special power or influence. DelftDAO is organised as a decentralised venture fund in which artists can freely share their work. Our core economic organising principle is direct ownership. Artists remain in control of their art. Citizens control their economy. Markets, states and megacorporations have no voice, no influence, and hold no power. All capital is directly owned, no central bank, commercial banks, or financial intermediaries exist. The economic primitives we rely on are permission-less rental of data storage and rental of computational power. We assume sufficient supply of storage and computation by profit seeking actors which are honest. We implemented a Tiktok-ish, Youtube-like platform for video streaming without relying on any cloud technology, Javascript, or browser technology of any kind. We show that Bitcoin can be used in a scalable manner using the Trustchain distributed ledger for full scalability as layer two. On top of the storage and computational primitives we are the first to successfully realise the economic primitive of collective ownership. A group of humans of unlimited size can own an unlimited amount of Bitcoins. No legal entity, platform, or government permission is needed. Critical to our success are our trust function and automagic investment function. Algorithmic translation of who is trustworthy, appetite for risk, and speculative investment. ToDo: proxy service, creative commons, pay-to-seed, self-expanding, git-commit-for-pay, Big Tech zero taxation habit, robot economy converging to a single Web3 DAO stack.

synctext commented 2 years ago

Democracy-as-a-service for Web3

To strengthen democracy we devised principles for digital self-rule and conducted a unique field experiment. We meticulously crafted a new digital community with thousands of real citizens in order to understand how to organise the global economy in a more fair, honest, impartial, and equitable manner. Self-governance of digital communities has been presented as an alternative to Big Tech. Despite decades of effort to re-decentralise The Internet, we have failed to make progress. The concentration of wealth and capital outside the reach of democratic oversight is relentlessly growing. Academics have documented Big Tech strategies for avoiding taxation and hiding profits, thereby hurting the public good[ref].

We believe designing The Internet as a business was a mistake. A privatized internet will always amount to the rule of the many by the few. Our Web3 vision is an Internet based on public interest, based on self-governance principles. A cardinal part of self-rule is the ability to adapt and grow. Without any exception, existing Web3 work uses central elements to offer their services. Existing web3 work uses central servers, committees with special power, or untrusted third parties. Our work is unique: it is based on academically-pure decentralisation. Nobody has any special powers. This provides a unique ability to grow and adapt. No permission, upkeep or maintenance is needed. {real details now coming} Our self-ruling community is based on rules which are digitally encoded into smart contracts. Evolving smart contracts has been an open scientific challenge.

We present a trustless on-chain governance model for refinement of these smart contracts. Any part of the community can self-organise and propose changes to the rules, collectively pool their funds, jointly commission the crafting of new smart contracts, and propose a global vote for change. When a majority approves the new rules, these smart contracts are deployed to the whole community and activated. Special property of our architecture is the defence against regulatory capture. Our serverless architecture uses mobile phones exclusively. Like Bitcoin and Bittorrent, it has no centrality. We carefully avoid the need for any bootstrap server, legal entity, or mining community to minimise our attack surface. {insert something big, like:}The United Nations is harnessing the inspirational power of a better future. The digital equivalence is a distant dream, but we believe our democracy-as-a-service can gravitate any socio-economic activity. We need democratic control and our work demonstrates viability. We need global search for a new core of democracy.

synctext commented 2 years ago

Self-regulating capitalism: the Delft experiments

Despite many examples in history of effective decentralized political systems, cultures and
businesses, the predominant perception of decentralization is that it is inherently fragile when
confronted with the utilitarian effectiveness of centralization. The reason for this is simple and
intuitive, one voice is more effective than many when it comes to clarity in decision making.
Uniformity in vision and clear delineation of authority are powerful tools when creating laws,
products, strategy and infrastructure because they avoid duplication of efforts and harness
creative vision towards accomplishing shared objectives. In contrast, decentralization requires
communication and compromise. Whereas in a centralized system a dissenting party may not
like the decision that has been made, in a decentralized system a dissenting party may be able
to keep a decision from being made at all.

intro from here

We present an experiment which provides irrefutable proof for the viability of a new economic paradigm. Self-regulating capitalism might be possible. Capitalism ensures economic efficiency because it is self-regulated through competition. When competition is no longer genuine a capitalist economy composed of private self-serving businesses will cease to be self-regulating. Key underpinnings of self-regulating capitalism are compliance-by-design in combination with extreme decentralisation.

We present "the Delft experiments" around a robust decentralised economy. Our economy is unique because of the academically-pure level of decentralisation, dubbed extreme decentralisation. Our cardinal design principle was to remove all central governance, to cut out any central company from the architecture, eliminate all central servers, and abolish all third parties. Similar to Bittorrent and Bitcoin our Delft experiments carefully avoids a single point of failure. Within our experiment Delft University of technology bypassed all intermediaries in finance, technology, and the music industry with a direct donation to musicians. We also demonstrate the viability of collective decision within our decentralised economy. Our experiment is focused on collective money allocation. A number of Internet volunteers donated money and participated "freely" with 100 Euro worth of value. The first 10 volunteers to successfully join the Delft experiment could vote on their favourite artist. After these volunteers joined in, we automatically doubled the available funds. The collective fund was disseminated proportional to the outcome of the democratic voting process by the 10 participating volunteers. Our second experiment demonstrates collective decision making around adaptation and growth. We conducted a field trail of our trustless on-chain governance model. We offered a bounty to any software developer who provides our robust decentralised economy with new functionality.

Architectural principles: democratic, non-custodian, permissionless, openly auditable, trustless, self-organising, zero-server, modular, en composable (e.g. lego fit of APIs). Related work (white paper only, nothing yet realised): https://colony.io/about-us

synctext commented 11 months ago

Decentralised Netflix: towards a better Internet

The Artist Investment Token is operational inside our MusicDAO. With the maturing DAO prototypes we are getting ready to add investments to our scientific portfolio together with identity, trust, money, markets, and AI. Next: investment in independent movie makers! Reading:

Brainstorm, Tribler DAO roadmap for 2026: list of indy movies asking for investments. Ranking by MetaMerit of these movie ideas. Proof-of-investment badges, decentralised kickstarter in DAO form with Bitcoins.

InvictusRMC commented 8 months ago

Progress update

InvictusRMC commented 8 months ago

Roadmap to a Leaderless Organisation on the Tribler Network

Goal: deploy a Decentralised Autonomous Organisation on top Tribler using MeritRank. We aim to create the first leaderless organisation on a decentralised network without global consensus or knowledge in which power is distributed through performed work rather than through wealth. Using this concept, we would be able to reward those clients that consistently perform any type of beneficial work for the network. Beneficial nodes can be provided with certain privileges (e.g., exit node priority).

November 2023

December 2023 - January 2024

January - March 2024

April - Aug 2024

InvictusRMC commented 7 months ago

Progress update

Durable Decentralised Economics for Distributed Ledger Technologies:

Other activities

synctext commented 7 months ago

Graphs of centralisation: https://www.coindesk.com/layer2/2022/04/20/is-ethereum-staking-pool-lidos-growth-an-omen-of-centralization/ Solution: competitiveness function? (not a goodness function, this is not a cosy collaborative, hypercapitalism, out-compete all for-profit firms by ruthless re-investment of all profits, win the winner-takes-all game)

Storyline: Not an alternative for consensus layer! With ledger economics we are consensus-free and replace proof-of-work + global consensus with a competitiveness function + fitness ranking + income distribution function.

2 pages of math! Prove: more decentralisation

System NO 51% risk of central party natural decentralisation (or global consensus-layer needed)
Mining pool :x: :x:
Staking pool :x: :x:
Ledger Economics :heavy_check_mark: :heavy_check_mark:
InvictusRMC commented 7 months ago

Progress update

Rowdy_Chotkan___Web3_Economics-draft-28-11-23.pdf

Other points

InvictusRMC commented 6 months ago

Progress Update

Other stuff

synctext commented 6 months ago

CFP ACM Ledger Journal: https://dl.acm.org/journal/dlt/calls-for-papers

Bitcoin, DAOs Decentralization Theater https://www.coindesk.com/consensus-magazine/2023/06/08/are-daos-doomed-to-decentralization-theater/

InvictusRMC commented 5 months ago

Progress

Other

InvictusRMC commented 5 months ago

Progress

Discussion points

synctext commented 5 months ago

CS people creating an economy, please read these papers and their cfp scope: ACM Transactions on Economics and Computation

InvictusRMC commented 4 months ago

Rendezvous Design Iteration

We simplify the rendezvous design, in turn lowering performance overhead and storage requirements. We now fully rely on the peer lifecycle. Per known peer $i$ we store the following information:

Now, the trust score $s_i$ for peer $i$ at timestamp $t$ is calculated with the following formula, where $di$ is the duration of the current connection (if any) and $\Delta t = t-t{i}$:

$s(t) = d_i / c_i + e$$-\lambda \Delta t$$\cdot s_{prev}$

In the example below, this leads to the following scores for nodes A and B at $t=7$, with $\lambda=0.05):

$s_i$   $= s(7) $       $= 1/5 + e$$-\lambda 0.5 $ $\cdot s(5.5) $       $= 1/5 + e$$-\lambda 0.5 $ $\cdot (1/4 + e$$-\lambda 0.5 $ $\cdot s(4))$       $= 1/5 + e$$-\lambda 0.5 $ $\cdot (1/4 + e$$-\lambda 0.5 $ $\cdot (1/3 + e$$-\lambda 0.5 $ $\cdot s(2.5)))$       $= 1/5 + e$$-\lambda 0.5 $ $\cdot (1/4 + e$$-\lambda 0.5 $ $\cdot (1/3 + e$$-\lambda 0.5 $ $\cdot (1/2 + e$$-\lambda 0.5 $ $\cdot s(1))))$       $= 1/5 + e$$-\lambda 0.5 $ $\cdot (1/4 + e$$-\lambda 0.5 $ $\cdot (1/3 + e$$-\lambda 0.5 $ $\cdot (1/2 + e$$-\lambda 0.5 $ $\cdot (1/1 + e$$-\lambda 0 $ $\cdot 0))))$       $\approx 2.13$

$S_{B} = 7/1 + e$$-\lambda 0 $ $\cdot 0 = 7$

Rendezvous Scenarios - Basics

Rendezvous Scenarios

synctext commented 4 months ago

Overall thesis storyline idea. Then we have the following 4-layered trust framework. Go for straight LCN storyline with networking part.

Layer Reputation Name Description
Application MeritRank Feedback at application layer, database storage, 100k people around you. Strangers which helped you in the past and you slightly trust. GPU exchange market and lottery function
Autonomous System ASRank Full AS list with their ratio of sybils, attacks, and honest peers. Identify clusters of bad actors and poorly managed IP-ranges. (AS count 74,200). Note, UDP spoofing
Network NetworkRank Currently online peers with their network stability, responsiveness, and aliveness. database storage, 10k currently around you
Personal identity SSIRank Self-sovereign identity with legally binding signatures under EU law. Total 448 million unique citizens in the EU realm, with enhanced legal protection from Big Tech.

NetworkRank idea comes from assignment for master student for EBSI passport-grade EU ID.

Intro from our prior "universal trust Machine" paper
### NetworkRank: A Decentralised Trust Network
Since the dawn of human civilization, trust has
been the core challenge of social organization. Trust functions to
reduce the effort spent in constantly monitoring others’ actions
in order to verify their assertions, thus facilitating cooperation
by allowing groups to function with reduced complexity. To
date, in modern societies, large scale trust is almost exclusively
provided by large centralized institutions. Specifically in the
case of the Internet, Big Tech companies maintain the largest
Internet platforms where users can interact, transact and share
information. Thus, they control who can interact and conduct
transactions through their monopoly of online trust.
Algorithms which provide some for of trust such as PageRank
have been notoriously hard to decentralise.
Our contribution is Internet-deployment of a large-scale trust
network. Prior work on decentralised trust mistakenly conjugated
the trustworthy overlay network with the human trust graph. We
show the effectiveness of splitting those two orthogonal dimensions
of trust. We propose NetworkRank for expressing the stability and
liveliness of any participant in the decentralised network overlays.
MeritRank represents the state-of-the-art algorithm to express
human collaboration and trust with resilience against fake identities
(sybil attack). Our NetworkRank ensures a single fully connected
network graph of opinions on network stability, responsiveness, and
aliveness. This enables graph-based algorithms such as MeritRank
to flourish. Key failing of prior work was the cost of maintenance of
trust. We studied all the various algorithms proposed in the past 20
years such as EigenTrust, TrustRank, PowerTrust, SybilRank,
SybilDefender, NetworkRank and extracted ideas to address the
overhead issue. NetworkRank is the first Internet-deployed mechanism
with deep packet-level integration at the network overlay layer,
thereby adding zero bandwidth overhead. All information is kept locally
and exclusively used to boost the effectiveness of MeritRank.

UPDATE: informed ddos mitigation based on reputation

grimadas commented 4 months ago

A small update on the progress:

We are developing a simple crawler that establishes aggressive connections with peers in the network and logs the timestamps of their IPv8 connections. The data is recorded in the following format:

<sha1 of peer key>.csv: 
connection_start_time, connection_end_time

This format allows us to process the data as needed later on, including calculating the stability and recency scores, as well as analyzing the dynamics of these scores. Each file documents the connection to a single peer, simplifying post-processing.

We have set the response timeout to the default IPv8 value of 60 seconds. At this time, I see no reason to adjust it.

qstokkink commented 4 months ago

Script complete: https://gist.github.com/qstokkink/29422919c1f28a5d0774b6447a582280

Crawler started at 11:54, 4th of March 2024. Aiming for shutdown at 11:54, 11th of March 2024.

synctext commented 3 months ago

So for the upcoming 7.14 experimental release - 1 we aim to prepare for 2 new novel features. Also hopefully a broad code cleanup.... :eyes: Both @InvictusRMC and @mg98 require Internet-deployment of their phd thesis ideas. With this step we prepare for MeritRank and decentralised machine learning deployment. MeritRank deployment is future work. So we build a fully connected graph of network stability and responsiveness. Second, pure rumour mongering of search results pairs for our operational (yet highly experimental) decentralised federated machine learning training using Google T5 transformer. So we randomly spread without any security measure at this point keyword searches and SHA1 of successfully downloaded torrents. We rely on the rumour spreading for privacy-preservation and need to further enhance this and add spam hardening in the future.

synctext commented 4 days ago

(btw bsc team of 5 == 4h/week)

Towards a concrete final publication

31 July deadline - learn-by-doing progress