search

Bot-detector / bot-detector

A plugin which pulls and sends surrounding player names from OSRS to a python server. The names and stats are then processed and assessed for bot-like behavior.
BSD 2-Clause "Simplified" License
58 stars 10 forks source link

Why do I have a 92% "bot" prediction? #170

Open essial opened 1 year ago

essial commented 1 year ago

This plugin says I'm 92% a bot 6% real player. I've never botted a single time ever. Also have a year premium account. I get margin of error but 92% isn't "kinda sure this is a bot" it's very sure I am a bot. I thought I was doing good by running this plugin, but if this is how wildly inaccurate the tool is I shutter to think how many innocent players I've caused to get banned by running it. I've removed it and hope others do too. I hate bots as much as the next guy but this plugin isn't it chief.

Screenshot 2022-11-28 at 7 34 59 PM
Ferrariic commented 1 year ago

Hey, what's your rsn so we can explain the results?

extreme4all commented 1 year ago

@essial The system works a bit like this, we define a bunch of "buckets" like "PVM Melee Bot", in this bucket we put alot of accounts that are banned, and we think look like the label, in this case "PVM Melee Bot".

The system then tries to see how similar you are compared to those buckets, we score the system based howmany % it is wrong.

What can happen is that your account does not fit well in one specific bucket, then our system tries to minimize its error. this usually happens when you see predictions < 75%, this basically means the model does not know.

Another thing that can happen is if you follow specific account builds, that a bucket of banned accounts tend to have then the system might put you in that bucket, this tends to happen with skilling or pvm alts.

at last, predictions when your total experience is "low" (<2000000 up to <5000000) then changes in your account build might change very wildly causing the system to be confused.

rest assured, we tend to only send accounts over 90% confidence, and jagex always does their own investigation.

extreme4all commented 1 year ago

on discord we have an option for you to create a ticket, where we will investigate your account https://discord.gg/bWKbk5Mg and see why it might be labeled a certain way

essial commented 1 year ago

Well if you send at 90% then I'm pretty sure you've already sent my account. I mean I'm not super worried. I've never botted (why would I automate playing a game that I am paying to play..). I pay money on RS and get yearly subs but if I get banned incorrectly I'll gladly spend my money elsewhere :)

FYI mya ccount is LunaticEdit9 and my skills are as thus:

Screenshot 2022-12-03 at 8 57 32 PM

And yes I'll kick back and listen/watch multiple hour long youtube videos on one monitor while running a single obstacle course or killing crabs on the other.

Cyborger1 commented 1 year ago

Your account currently predicts as "Stats too low", and has already shifted towards Real Player in the breakdown. I don't think there's anything here to be worried about.

Again, the % being volatile on the early totals (typically below 1000 total) is expected and accounted for on our side.

extreme4all commented 1 year ago

tbh looking at the data on the highscores image

i'm surprised the prediction is as follows image

however as stated by cyborger lower than 1000 total & 2-5m exp than the predictions are vollatile lower than 846 total level doesn't even register on the hiscores https://secure.runescape.com/m=hiscore_oldschool/overall?table=0&page=80000 image