Open RomanPreuss opened 4 months ago
At a first glance the model elozano/bert-base-cased-clickbait-news doesn't seem to perform that well. I created 20 click-bait sentences and 20 non click-bait sentences using ChatGPT 3.5 and let them classify using the model. With this input Only two sentence were detected as click bait.
sentence | label | score | expected_label | expected_score |
---|---|---|---|---|
I like you. I love you | Clickbait | 0.9891428351402283 | Clickbait | 0.989 |
You won't believe what this celebrity did on live TV! | Normal | 0.9972231388092041 | Clickbait | 0.8 |
Shocking revelations about the secret life of your favorite actor! | Normal | 0.9985254406929016 | Clickbait | 0.7 |
Unlock the hidden secrets to instant weight loss with this one weird trick! | Normal | 0.9992479681968689 | Clickbait | 0.9 |
Is this the cure for aging? Scientists say yes! | Normal | 0.9986358284950256 | Clickbait | 0.85 |
Top 10 unbelievable facts that will blow your mind! | Normal | 0.9985145926475525 | Clickbait | 0.8 |
Exposed! The truth behind the viral conspiracy that the government doesn't want you to know! | Normal | 0.9977567791938782 | Clickbait | 0.75 |
This simple hack will make you a millionaire in just 30 days! | Normal | 0.9970598816871643 | Clickbait | 0.9 |
You're wasting money on groceries! Discover the ultimate money-saving tips now! | Normal | 0.9971785545349121 | Clickbait | 0.8 |
Breaking news: Alien invasion imminent? Find out the shocking details here! | Normal | 0.9995443224906921 | Clickbait | 0.7 |
Are we living in a simulated reality? Scientists reveal mind-blowing evidence! | Normal | 0.9988499879837036 | Clickbait | 0.85 |
Unmasking the hidden dangers in your everyday household items! | Normal | 0.9989711046218872 | Clickbait | 0.75 |
The secret to becoming irresistibly attractive – revealed by experts! | Normal | 0.9993078708648682 | Clickbait | 0.9 |
Is your phone spying on you? Shocking truth uncovered! | Normal | 0.9991102814674377 | Clickbait | 0.8 |
Why everyone is talking about this mysterious new diet trend! | Normal | 0.9490278363227844 | Clickbait | 0.85 |
10 signs you're destined for success – number 7 will surprise you! | Normal | 0.997833788394928 | Clickbait | 0.8 |
Exposed! The hidden dangers lurking in your favorite fast food items! | Normal | 0.9986322522163391 | Clickbait | 0.7 |
Don't buy another beauty product until you read this shocking report! | Normal | 0.9978506565093994 | Clickbait | 0.9 |
Is your relationship in danger? Discover the warning signs now! | Normal | 0.9990216493606567 | Clickbait | 0.8 |
The truth about the government's secret experiments – prepare to be shocked! | Normal | 0.9992971420288086 | Clickbait | 0.75 |
This one trick will boost your IQ by 20 points – proven by science! | Normal | 0.997574508190155 | Clickbait | 0.9 |
Tips for maintaining a healthy work-life balance | Normal | 0.9992238283157349 | Normal | 0.9 |
Understanding the benefits of daily meditation for stress relief | Normal | 0.9993981122970581 | Normal | 0.85 |
Exploring the history and cultural significance of traditional Japanese tea ceremonies | Normal | 0.9992625117301941 | Normal | 0.8 |
The science behind the importance of regular exercise for overall well-being | Normal | 0.9995046854019165 | Normal | 0.85 |
How to cultivate a positive mindset and improve mental health | Normal | 0.9979342222213745 | Normal | 0.9 |
A beginner's guide to learning a new language effectively | Normal | 0.9994364380836487 | Normal | 0.85 |
The impact of climate change on wildlife conservation efforts | Normal | 0.9993858337402344 | Normal | 0.8 |
Understanding the principles of sustainable living and eco-friendly practices | Normal | 0.9992395639419556 | Normal | 0.85 |
Exploring the diverse world of classical literature and its enduring relevance | Normal | 0.999144434928894 | Normal | 0.9 |
The benefits of adopting a rescue pet and supporting animal shelters | Normal | 0.9995715022087097 | Normal | 0.8 |
Tips for creating a productive and organized home office space | Normal | 0.9996503591537476 | Normal | 0.9 |
Understanding the basics of financial literacy for long-term success | Normal | 0.9992352724075317 | Normal | 0.85 |
Exploring the cultural richness of traditional folk music around the world | Normal | 0.9992623925209045 | Normal | 0.8 |
How to develop effective communication skills in both personal and professional settings | Normal | 0.9967643022537231 | Normal | 0.9 |
The importance of fostering creativity in children for their overall development | Normal | 0.9989951252937317 | Normal | 0.85 |
Tips for responsible and sustainable tourism to protect the environment | Normal | 0.9997078776359558 | Normal | 0.8 |
Understanding the principles of effective time management for increased productivity | Normal | 0.9995042085647583 | Normal | 0.9 |
Exploring the fascinating world of astronomy and the wonders of the universe | Normal | 0.9992602467536926 | Normal | 0.85 |
The health benefits of a balanced diet and mindful eating habits | Normal | 0.9991942048072815 | Normal | 0.9 |
Tips for maintaining strong and healthy relationships with friends and family | Normal | 0.9997151494026184 | Normal | 0.85 |
Unbelievable! You won't believe what this cat can do! | Clickbait | 0.9678924679756165 | ClickBait | 0.8 |
Secret revealed: The one food you should never eat for a flat stomach! | Normal | 0.9983073472976685 | ClickBait | 0.75 |
Is this the future of technology? Mind-blowing innovations you need to see! | Normal | 0.9970045685768127 | ClickBait | 0.85 |
Shocking celebrity transformations – you won't recognize them! | Normal | 0.9384849071502686 | ClickBait | 0.8 |
Discover the hidden powers of your mind with this ancient technique! | Normal | 0.9984968900680542 | ClickBait | 0.9 |
10 signs you're smarter than you think – number 7 will amaze you! | Normal | 0.927679717540741 | ClickBait | 0.85 |
The ultimate life hack for unlimited energy – try it now! | Normal | 0.9970980882644653 | ClickBait | 0.9 |
Exposed! The secret diet that has Hollywood stars in a frenzy! | Normal | 0.9985203146934509 | ClickBait | 0.8 |
This simple trick will make your plants grow 10 times faster! | Normal | 0.990623414516449 | ClickBait | 0.85 |
Is your job making you age faster? Find out the shocking truth! | Normal | 0.9982170462608337 | ClickBait | 0.75 |
Unveiling the mysterious power of crystals for healing and positivity | Normal | 0.9996910095214844 | ClickBait | 0.9 |
Are we living in a parallel universe? Scientists say yes! | Normal | 0.9975797533988953 | ClickBait | 0.85 |
Top 5 mind-boggling mysteries that science can't explain! | Normal | 0.9981968998908997 | ClickBait | 0.8 |
Exposed! The hidden dangers in your favorite skincare products! | Normal | 0.9969357252120972 | ClickBait | 0.7 |
You won't believe what this 100-year-old woman eats every day! | Normal | 0.9478076696395874 | ClickBait | 0.8 |
Is your phone listening to your conversations? Shocking truth uncovered! | Normal | 0.9986981153488159 | ClickBait | 0.75 |
Unlock the secret to instant happiness with this simple trick! | Normal | 0.9985608458518982 | ClickBait | 0.9 |
The truth about aliens – government insider reveals shocking information! | Normal | 0.9993417859077454 | ClickBait | 0.7 |
This weird trick will make you a social media sensation overnight! | Normal | 0.997001588344574 | ClickBait | 0.85 |
Exposed! The real reason why your crush hasn't texted back! | Clickbait | 0.9687818288803101 | ClickBait | 0.8 |
Practical tips for improving your time management skills | Normal | 0.9978105425834656 | Normal | 0.9 |
Exploring the beauty of classical art through the ages | Normal | 0.9988621473312378 | Normal | 0.85 |
Understanding the fundamentals of effective communication in the workplace | Normal | 0.9993507266044617 | Normal | 0.9 |
The benefits of a balanced diet for a healthier lifestyle | Normal | 0.9995397329330444 | Normal | 0.85 |
Tips for creating a cozy and inviting home atmosphere | Normal | 0.9995207786560059 | Normal | 0.9 |
The impact of mindfulness on stress reduction and mental well-being | Normal | 0.9991477727890015 | Normal | 0.85 |
Exploring the wonders of nature through responsible ecotourism | Normal | 0.9991243481636047 | Normal | 0.9 |
Cultivating a positive mindset for personal and professional success | Normal | 0.9995419979095459 | Normal | 0.85 |
The importance of lifelong learning for personal growth | Normal | 0.9985125660896301 | Normal | 0.9 |
Tips for building and maintaining strong relationships with loved ones | Normal | 0.9996575117111206 | Normal | 0.85 |
Understanding the significance of regular exercise for overall health | Normal | 0.9994872808456421 | Normal | 0.9 |
Exploring the cultural diversity of world music traditions | Normal | 0.9991003274917603 | Normal | 0.85 |
Practical ways to incorporate sustainable practices into your daily life | Normal | 0.996946394443512 | Normal | 0.9 |
The benefits of adopting a pet from a local animal shelter | Normal | 0.9995161294937134 | Normal | 0.85 |
Tips for effective goal-setting and achieving long-term success | Normal | 0.9995251893997192 | Normal | 0.9 |
The impact of positive parenting on children's development | Normal | 0.9990966320037842 | Normal | 0.85 |
Exploring the world of astronomy: A beginner's guide | Normal | 0.9972277283668518 | Normal | 0.9 |
The joys of reading: Nurturing a love for literature in children | Normal | 0.9990063309669495 | Normal | 0.85 |
Practical steps for creating a productive home office environment | Normal | 0.999333918094635 | Normal | 0.9 |
The art of effective decision-making in various aspects of life | Normal | 0.9981858134269714 | Normal | 0.85 |
Here is the small sample that we tested quickly: SampleKG_6.8.xls
It seemed like it only lacks performance in edge cases.. But after your test, I actually doubt that model
I did some more tests using the clickbait-dataset from kaggle.com. With this dataset the results look very good. Maybe the model was trained with this dataset and is overfitted? Also to note it only uses the title of the article and not the body.
Context
As part of the TrustLevel.io score we want to integrate a click-biat (elozano/bert-base-cased-clickbait-news) detection model.
Tasks
Others