DEV: Make tracking information available

darionewmonday commented 5 years ago

Questions we want to answer with the tracking and indicators we want to use: How many people find the tool? --> page views How do people use the tool? --> interaction parameters like link clicks (search results and help links), time they stay on the page Which topics are interesting for users? --> terms entered in the search field Do users edit after using the tool? --> edit count after they used the tool Do users make the suggested edits or other edits? --> edit type after they used the tool

Comments/Solutions: It needs to be clarified with WMF whether tracking in toollabs-environment is possible Internal tracking solutions for webpages is matomo Single log in needs to be activated in order to track editing behavior of users after they leave the tool (OAuth)

dev-ckln commented 5 years ago

We can add tracking for various things on our side but can't do that on wikipedia site.

darionewmonday commented 5 years ago

Can you elaborate this pls?

Il lun 2 set 2019, 14:58 Deepak notifications@github.com ha scritto:

We can add tracking for various things on our side but can't do that on wikipedia site.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/wmde/mitmachen/issues/17?email_source=notifications&email_token=AM3ICHET3NSOUEI2LUWI6J3QHUEXDA5CNFSM4IPNZ5NKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5VYCXY#issuecomment-527139167, or mute the thread https://github.com/notifications/unsubscribe-auth/AM3ICHGOJKU4P7Y3743TVSLQHUEXDANCNFSM4IPNZ5NA .

ChristineDomgoergen commented 5 years ago

Hi @darionewmonday, so we need some figures on the usage of the tool itself:

page views
interaction parameters like link clicks etc.
terms entered in the search field

--> these are things which probably can be tracked in the tool itself ("our side" if I understand Deepak's comment correctly)

Then we need some figures on the impact of the tool usage on edits of users.

Do users edit after using the tool? --> edit count after they used the tool
Do users make the suggested edits or other edits? --> edit type after they used the tool

These cannot be tracked in the tool itself. Our idea was to get the user to log-in using Oauth in the tool because then we can probably track (ourselves, we have a data analyst) the edits they make in Wikipedia ("wikipedia site" as Deepak calls it). We discussed this briefly in the Kick-Off:

it is difficult though to get the user to log in because they don't see the benefit.
it is unclear, if users are automatically logged in in Wikipedia when they log in in the tool, then leave the tool and go to Wikipedia

Does this help?

dev-ckln commented 5 years ago

So there is two kind of data that we want , one is from our tool and that can be tracked very easily no problem in that for example:-

page views interaction parameters like link clicks etc. terms entered in the search field

But the tracking that we want after the user has been redirected to wikipedia is the tricky one , Give me time for today , I'll look for some table in the DB that we have for something related to that.

Will update on this one today.

darionewmonday commented 5 years ago

@dev-ckln thank you. Please do not invest more than 1 hour researching this topic. If it's too complex, we must find a different solution or go just for the first option you have suggested. Thanks

dev-ckln commented 5 years ago

Okay Got it.

ChristineDomgoergen commented 5 years ago

@darionewmonday @dev-ckln Yes, we can do this part of the tracking. The only thing to check from your side is if users are automatically logged in in Wikipedia when they log in in the tool, then leave the tool and go to Wikipedia.

And we should discuss if it makes sense to to establish oauth - the single log in in the tool, so we have a basis for further tracking in the future.

dev-ckln commented 5 years ago

@tobijat I was creating a tracking table in the DB but it shows the following error

ERROR 1290 (HY000): The MariaDB server is running with the --read-only option so it cannot execute this statement

Can you please check?

darionewmonday commented 5 years ago

Mention Tobi pls

dev-ckln commented 5 years ago

@tobijat DB permission is required

tobijat commented 5 years ago

@dev-ckln here's the documentation about databases on toolforge: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Connecting_to_the_database_replicas Which DB did you connect to and tried writing to? The replica one is read-only.

dev-ckln commented 5 years ago

@tobijat Here are the steps that I follow to connect to DB

ssh into server using my rsa key
then I type become mitmachen
and then to connect to DB, I type sql dewiki_p

Please let me know if something is wrong.

tobijat commented 5 years ago

@dev-ckln dewiki_p is a replica of the live system and is read-only. You can't create new tables there. I think what you need is to connect to the ToolsDB (it's described in the link I've posted above), there you should be able to create own tables. Nothing more I can tell, as I've not worked with custom DBs on toolforge before.

dev-ckln commented 5 years ago

@tobijat I checked the link and I think they won't allow us to connect to production or live database as is evident from the first line of the documentation. Also I tried to find what other DBs are there on the server. Here's a list of them, please let me know if any of them seems familiar to you in regard to being production or not

aawiki_p
aawikibooks_p
aawiktionary_p
abwiki_p
abwiktionary_p
acewiki_p
advisorywiki_p
adywiki_p
afwiki_p
afwikibooks_p
afwikiquote_p
afwiktionary_p
akwiki_p
akwikibooks_p
akwiktionary_p
alswiki_p
amwiki_p
amwikimedia_p
amwikiquote_p
amwiktionary_p
angwiki_p
angwikibooks_p
angwikiquote_p
angwikisource_p
angwiktionary_p
anwiki_p
anwiktionary_p
arcwiki_p
arwiki_p
arwikibooks_p
arwikimedia_p
arwikinews_p
arwikiquote_p
arwikisource_p
arwikiversity_p
arwiktionary_p
arzwiki_p
astwiki_p
astwikibooks_p
astwikiquote_p
astwiktionary_p
aswiki_p
aswikibooks_p
aswikisource_p
aswiktionary_p
atjwiki_p
avwiki_p
avwiktionary_p
aywiki_p
aywikibooks_p
aywiktionary_p
azbwiki_p
azwiki_p
azwikibooks_p
azwikiquote_p
azwikisource_p
azwiktionary_p
barwiki_p
bat_smgwiki_p
bawiki_p
bawikibooks_p
bclwiki_p
bdwikimedia_p
be_x_oldwiki_p
betawikiversity_p
bewiki_p
bewikibooks_p
bewikimedia_p
bewikiquote_p
bewikisource_p
bewiktionary_p
bgwiki_p
bgwikibooks_p
bgwikinews_p
bgwikiquote_p
bgwikisource_p
bgwiktionary_p
bhwiki_p
bhwiktionary_p
biwiki_p
biwikibooks_p
biwiktionary_p
bjnwiki_p
bmwiki_p
bmwikibooks_p
bmwikiquote_p
bmwiktionary_p
bnwiki_p
bnwikibooks_p
bnwikisource_p
bnwikivoyage_p
bnwiktionary_p
bowiki_p
bowikibooks_p
bowiktionary_p
bpywiki_p
brwiki_p
brwikimedia_p
brwikiquote_p
brwikisource_p
brwiktionary_p
bswiki_p
bswikibooks_p
bswikinews_p
bswikiquote_p
bswikisource_p
bswiktionary_p
bugwiki_p
bxrwiki_p
cawiki_p
cawikibooks_p
cawikimedia_p
cawikinews_p
cawikiquote_p
cawikisource_p
cawiktionary_p
cbk_zamwiki_p
cdowiki_p
cebwiki_p
centralauth_p
cewiki_p
chowiki_p
chrwiki_p
chrwiktionary_p
chwiki_p
chwikibooks_p
chwiktionary_p
chywiki_p
ckbwiki_p
cnwikimedia_p
commonswiki_p
cowiki_p
cowikibooks_p
cowikimedia_p
cowikiquote_p
cowiktionary_p
crhwiki_p
crwiki_p
crwikiquote_p
crwiktionary_p
csbwiki_p
csbwiktionary_p
cswiki_p
cswikibooks_p
cswikinews_p
cswikiquote_p
cswikisource_p
cswikiversity_p
cswiktionary_p
cuwiki_p
cvwiki_p
cvwikibooks_p
cywiki_p
cywikibooks_p
cywikiquote_p
cywikisource_p
cywiktionary_p
dawiki_p
dawikibooks_p
dawikiquote_p
dawikisource_p
dawiktionary_p
dewiki_p
dewikibooks_p
dewikinews_p
dewikiquote_p
dewikisource_p
dewikiversity_p
dewikivoyage_p
dewiktionary_p
dinwiki_p
diqwiki_p
dkwikimedia_p
donatewiki_p
dsbwiki_p
dtywiki_p
dvwiki_p
dvwiktionary_p
dzwiki_p
dzwiktionary_p
eewiki_p
elwiki_p
elwikibooks_p
elwikinews_p
elwikiquote_p
elwikisource_p
elwikiversity_p
elwikivoyage_p
elwiktionary_p
emlwiki_p
enwiki_p
enwikibooks_p
enwikinews_p
enwikiquote_p
enwikisource_p
enwikiversity_p
enwikivoyage_p
enwiktionary_p
eowiki_p
eowikibooks_p
eowikinews_p
eowikiquote_p
eowikisource_p
eowiktionary_p
eswiki_p
eswikibooks_p
eswikinews_p
eswikiquote_p
eswikisource_p
eswikiversity_p
eswikivoyage_p
eswiktionary_p
etwiki_p
etwikibooks_p
etwikimedia_p
etwikiquote_p
etwikisource_p
etwiktionary_p
euwiki_p
euwikibooks_p
euwikiquote_p
euwikisource_p
euwiktionary_p
extwiki_p
fawiki_p
fawikibooks_p
fawikinews_p
fawikiquote_p
fawikisource_p
fawikivoyage_p
fawiktionary_p
ffwiki_p
fiu_vrowiki_p
fiwiki_p
fiwikibooks_p
fiwikimedia_p
fiwikinews_p
fiwikiquote_p
fiwikisource_p
fiwikiversity_p
fiwikivoyage_p
fiwiktionary_p
fixcopyrightwiki_p
fjwiki_p
fjwiktionary_p
foundationwiki_p
fowiki_p
fowikisource_p
fowiktionary_p
frpwiki_p
frrwiki_p
frwiki_p
frwikibooks_p
frwikinews_p
frwikiquote_p
frwikisource_p
frwikiversity_p
frwikivoyage_p
frwiktionary_p
furwiki_p
fywiki_p
fywikibooks_p
fywiktionary_p
gagwiki_p
ganwiki_p
gawiki_p
gawikibooks_p
gawikiquote_p
gawiktionary_p
gdwiki_p
gdwiktionary_p
glkwiki_p
glwiki_p
glwikibooks_p
glwikiquote_p
glwikisource_p
glwiktionary_p
gnwiki_p
gnwikibooks_p
gnwiktionary_p
gomwiki_p
gorwiki_p
gotwiki_p
gotwikibooks_p
guwiki_p
guwikibooks_p
guwikiquote_p
guwikisource_p
guwiktionary_p
gvwiki_p
gvwiktionary_p
hakwiki_p
hawiki_p
hawiktionary_p
hawwiki_p
heartbeat_p
hewiki_p
hewikibooks_p
hewikinews_p
hewikiquote_p
hewikisource_p
hewikivoyage_p
hewiktionary_p
hifwiki_p
hifwiktionary_p
hiwiki_p
hiwikibooks_p
hiwikimedia_p
hiwikiquote_p
hiwikiversity_p
hiwikivoyage_p
hiwiktionary_p
howiki_p
hrwiki_p
hrwikibooks_p
hrwikiquote_p
hrwikisource_p
hrwiktionary_p
hsbwiki_p
hsbwiktionary_p
htwiki_p
htwikisource_p
huwiki_p
huwikibooks_p
huwikinews_p
huwikiquote_p
huwikisource_p
huwiktionary_p
hywiki_p
hywikibooks_p
hywikiquote_p
hywikisource_p
hywiktionary_p
hywwiki_p
hzwiki_p
iawiki_p
iawikibooks_p
iawiktionary_p
idwiki_p
idwikibooks_p
idwikimedia_p
idwikiquote_p
idwikisource_p
idwiktionary_p
iewiki_p
iewikibooks_p
iewiktionary_p
igwiki_p
iiwiki_p
ikwiki_p
ikwiktionary_p
ilowiki_p
incubatorwiki_p
information_schema
information_schema_p
inhwiki_p
iowiki_p
iowiktionary_p
iswiki_p
iswikibooks_p
iswikiquote_p
iswikisource_p
iswiktionary_p
itwiki_p
itwikibooks_p
itwikinews_p
itwikiquote_p
itwikisource_p
itwikiversity_p
itwikivoyage_p
itwiktionary_p
iuwiki_p
iuwiktionary_p
jamwiki_p
jawiki_p
jawikibooks_p
jawikinews_p
jawikiquote_p
jawikisource_p
jawikiversity_p
jawiktionary_p
jbowiki_p
jbowiktionary_p
jvwiki_p
jvwiktionary_p
kaawiki_p
kabwiki_p
kawiki_p
kawikibooks_p
kawikiquote_p
kawiktionary_p
kbdwiki_p
kbpwiki_p
kgwiki_p
kiwiki_p
kjwiki_p
kkwiki_p
kkwikibooks_p
kkwikiquote_p
kkwiktionary_p
klwiki_p
klwiktionary_p
kmwiki_p
kmwikibooks_p
kmwiktionary_p
knwiki_p
knwikibooks_p
knwikiquote_p
knwikisource_p
knwiktionary_p
koiwiki_p
kowiki_p
kowikibooks_p
kowikinews_p
kowikiquote_p
kowikisource_p
kowikiversity_p
kowiktionary_p
krcwiki_p
krwiki_p
krwikiquote_p
kshwiki_p
kswiki_p
kswikibooks_p
kswikiquote_p
kswiktionary_p
kuwiki_p
kuwikibooks_p
kuwikiquote_p
kuwiktionary_p
kvwiki_p
kwwiki_p
kwwikiquote_p
kwwiktionary_p
kywiki_p
kywikibooks_p
kywikiquote_p
kywiktionary_p
ladwiki_p
lawiki_p
lawikibooks_p
lawikiquote_p
lawikisource_p
lawiktionary_p
lbewiki_p
lbwiki_p
lbwikibooks_p
lbwikiquote_p
lbwiktionary_p
lezwiki_p
lfnwiki_p
lgwiki_p
lijwiki_p
liwiki_p
liwikibooks_p
liwikinews_p
liwikiquote_p
liwikisource_p
liwiktionary_p
lmowiki_p
lnwiki_p
lnwikibooks_p
lnwiktionary_p
loginwiki_p
lowiki_p
lowiktionary_p
lrcwiki_p
ltgwiki_p
ltwiki_p
ltwikibooks_p
ltwikiquote_p
ltwikisource_p
ltwiktionary_p
lvwiki_p
lvwikibooks_p
lvwiktionary_p
maiwiki_p
maiwikimedia_p
map_bmswiki_p
mdfwiki_p
mediawikiwiki_p
meta_p
metawiki_p
mgwiki_p
mgwikibooks_p
mgwiktionary_p
mhrwiki_p
mhwiki_p
mhwiktionary_p
minwiki_p
miwiki_p
miwikibooks_p
miwiktionary_p
mkwiki_p
mkwikibooks_p
mkwikimedia_p
mkwikisource_p
mkwiktionary_p
mlwiki_p
mlwikibooks_p
mlwikiquote_p
mlwikisource_p
mlwiktionary_p
mnwiki_p
mnwikibooks_p
mnwiktionary_p
mrjwiki_p
mrwiki_p
mrwikibooks_p
mrwikiquote_p
mrwikisource_p
mrwiktionary_p
mswiki_p
mswikibooks_p
mswiktionary_p
mtwiki_p
mtwiktionary_p
muswiki_p
mwlwiki_p
mxwikimedia_p
myvwiki_p
mywiki_p
mywikibooks_p
mywiktionary_p
mznwiki_p
nahwiki_p
nahwikibooks_p
nahwiktionary_p
napwiki_p
napwikisource_p
nawiki_p
nawikibooks_p
nawikiquote_p
nawiktionary_p
nds_nlwiki_p
ndswiki_p
ndswikibooks_p
ndswikiquote_p
ndswiktionary_p
newiki_p
newikibooks_p
newiktionary_p
newwiki_p
ngwiki_p
nlwiki_p
nlwikibooks_p
nlwikimedia_p
nlwikinews_p
nlwikiquote_p
nlwikisource_p
nlwikivoyage_p
nlwiktionary_p
nnwiki_p
nnwikiquote_p
nnwiktionary_p
nostalgiawiki_p
novwiki_p
nowiki_p
nowikibooks_p
nowikimedia_p
nowikinews_p
nowikiquote_p
nowikisource_p
nowiktionary_p
nrmwiki_p
nsowiki_p
nvwiki_p
nycwikimedia_p
nywiki_p
nzwikimedia_p
ocwiki_p
ocwikibooks_p
ocwiktionary_p
olowiki_p
omwiki_p
omwiktionary_p
orwiki_p
orwikisource_p
orwiktionary_p
oswiki_p
outreachwiki_p
pa_uswikimedia_p
pagwiki_p
pamwiki_p
papwiki_p
pawiki_p
pawikibooks_p
pawikisource_p
pawiktionary_p
pcdwiki_p
pdcwiki_p
pflwiki_p
pihwiki_p
piwiki_p
piwiktionary_p
plwiki_p
plwikibooks_p
plwikimedia_p
plwikinews_p
plwikiquote_p
plwikisource_p
plwikivoyage_p
plwiktionary_p
pmswiki_p
pmswikisource_p
pnbwiki_p
pnbwiktionary_p
pntwiki_p
pswiki_p
pswikibooks_p
pswikivoyage_p
pswiktionary_p
ptwiki_p
ptwikibooks_p
ptwikimedia_p
ptwikinews_p
ptwikiquote_p
ptwikisource_p
ptwikiversity_p
ptwikivoyage_p
ptwiktionary_p
punjabiwikimedia_p
qualitywiki_p
quwiki_p
quwikibooks_p
quwikiquote_p
quwiktionary_p
rmwiki_p
rmwikibooks_p
rmwiktionary_p
rmywiki_p
rnwiki_p
rnwiktionary_p
roa_rupwiki_p
roa_rupwiktionary_p
roa_tarawiki_p
romdwikimedia_p
rowiki_p
rowikibooks_p
rowikinews_p
rowikiquote_p
rowikisource_p
rowikivoyage_p
rowiktionary_p
rswikimedia_p
ruewiki_p
ruwiki_p
ruwikibooks_p
ruwikimedia_p
ruwikinews_p
ruwikiquote_p
ruwikisource_p
ruwikiversity_p
ruwikivoyage_p
ruwiktionary_p
rwwiki_p
rwwiktionary_p
sahwiki_p
sahwikiquote_p
sahwikisource_p
satwiki_p
sawiki_p
sawikibooks_p
sawikiquote_p
sawikisource_p
sawiktionary_p
scnwiki_p
scnwiktionary_p
scowiki_p
scwiki_p
scwiktionary_p
sdwiki_p
sdwikinews_p
sdwiktionary_p
sewiki_p
sewikibooks_p
sewikimedia_p
sgwiki_p
sgwiktionary_p
shnwiki_p
shwiki_p
shwiktionary_p
simplewiki_p
simplewikibooks_p
simplewikiquote_p
simplewiktionary_p
siwiki_p
siwikibooks_p
siwiktionary_p
skwiki_p
skwikibooks_p
skwikiquote_p
skwikisource_p
skwiktionary_p
slwiki_p
slwikibooks_p
slwikiquote_p
slwikisource_p
slwikiversity_p
slwiktionary_p
smwiki_p
smwiktionary_p
snwiki_p
snwiktionary_p
sourceswiki_p
sowiki_p
sowiktionary_p
specieswiki_p
sqwiki_p
sqwikibooks_p
sqwikinews_p
sqwikiquote_p
sqwiktionary_p
srnwiki_p
srwiki_p
srwikibooks_p
srwikinews_p
srwikiquote_p
srwikisource_p
srwiktionary_p
sswiki_p
sswiktionary_p
stqwiki_p
strategywiki_p
stwiki_p
stwiktionary_p
suwiki_p
suwikibooks_p
suwikiquote_p
suwiktionary_p
svwiki_p
svwikibooks_p
svwikinews_p
svwikiquote_p
svwikisource_p
svwikiversity_p
svwikivoyage_p
svwiktionary_p
swwiki_p
swwikibooks_p
swwiktionary_p
szlwiki_p
tawiki_p
tawikibooks_p
tawikinews_p
tawikiquote_p
tawikisource_p
tawiktionary_p
tcywiki_p
tenwiki_p
test2wiki_p
testcommonswiki_p
testwiki_p
testwikidatawiki_p
tetwiki_p
tewiki_p
tewikibooks_p
tewikiquote_p
tewikisource_p
tewiktionary_p
tgwiki_p
tgwikibooks_p
tgwiktionary_p
thwiki_p
thwikibooks_p
thwikinews_p
thwikiquote_p
thwikisource_p
thwiktionary_p
tiwiki_p
tiwiktionary_p
tkwiki_p
tkwikibooks_p
tkwikiquote_p
tkwiktionary_p
tlwiki_p
tlwikibooks_p
tlwiktionary_p
tnwiki_p
tnwiktionary_p
towiki_p
towiktionary_p
tpiwiki_p
tpiwiktionary_p
trwiki_p
trwikibooks_p
trwikimedia_p
trwikinews_p
trwikiquote_p
trwikisource_p
trwiktionary_p
tswiki_p
tswiktionary_p
ttwiki_p
ttwikibooks_p
ttwikiquote_p
ttwiktionary_p
tumwiki_p
twwiki_p
twwiktionary_p
tyvwiki_p
tywiki_p
uawikimedia_p
udmwiki_p
ugwiki_p
ugwikibooks_p
ugwikiquote_p
ugwiktionary_p
ukwiki_p
ukwikibooks_p
ukwikinews_p
ukwikiquote_p
ukwikisource_p
ukwikivoyage_p
ukwiktionary_p
urwiki_p
urwikibooks_p
urwikiquote_p
urwiktionary_p
usabilitywiki_p
uzwiki_p
uzwikibooks_p
uzwikiquote_p
uzwiktionary_p
vecwiki_p
vecwikisource_p
vecwiktionary_p
vepwiki_p
vewiki_p
viwiki_p
viwikibooks_p
viwikiquote_p
viwikisource_p
viwikivoyage_p
viwiktionary_p
vlswiki_p
votewiki_p
vowiki_p
vowikibooks_p
vowikiquote_p
vowiktionary_p
warwiki_p
wawiki_p
wawikibooks_p
wawiktionary_p
wbwikimedia_p
wikidatawiki_p
wikimania2005wiki_p
wikimania2006wiki_p
wikimania2007wiki_p
wikimania2008wiki_p
wikimania2009wiki_p
wikimania2010wiki_p
wikimania2011wiki_p
wikimania2012wiki_p
wikimania2013wiki_p
wikimania2014wiki_p
wikimania2015wiki_p
wikimania2016wiki_p
wikimania2017wiki_p
wikimania2018wiki_p
wikimaniawiki_p
wowiki_p
wowikiquote_p
wowiktionary_p
wuuwiki_p
xalwiki_p
xhwiki_p
xhwikibooks_p
xhwiktionary_p
xmfwiki_p
yiwiki_p
yiwikisource_p
yiwiktionary_p
yowiki_p
yowikibooks_p
yowiktionary_p
yuewiktionary_p
zawiki_p
zawikibooks_p
zawikiquote_p
zawiktionary_p
zeawiki_p
zh_classicalwiki_p
zh_min_nanwiki_p
zh_min_nanwikibooks_p
zh_min_nanwikiquote_p
zh_min_nanwikisource_p zh_min_nanwiktionary_p zh_yuewiki_p
zhwiki_p
zhwikibooks_p
zhwikinews_p
zhwikiquote_p
zhwikisource_p
zhwikiversity_p
zhwikivoyage_p
zhwiktionary_p
zuwiki_p
zuwikibooks_p
zuwiktionary_p

Also as the above link states to connect to ToolsDB, use sql local which I did, then I typed show tables; It showed error that no tables is there, please select Database, then I typed `show databases;' It showed me a list of databases, now I don't know which database is the correct one, maybe you can help in that, here is the list of all databases information_schema
s51071templatetiger_p
s51072__internallinks_p
s51075flickrfree_p
s51080checkwiki_p
s51100wp10_p
s51100_mass_translate_p
s51111common_p
s51138heritage_p
s51172ilc_p
s51192__wlx_p
s51203baglama2_p
s51203inventory_p
s51205__terminator_p
s51211duplicity_p
s51211feed_p
s51211__ib2_p
s51211monitor_p
s51211pagepile_p
s51211__sourcerer_p
s51211uk_grade2_p
s51211wikidata_cache_p
s51211wikidata_merge_by_id_p
s51218wdfist_p
s51290__dpl_p
s51296huwiki_p
s51306copyright_p
s51330__copyvios_p
s51334enwiki_first_page_revisions_p s51402commonsedge_p
s51415__stations_p
s51430bswiki_first_page_revisions_p s51434mixnmatch2015_p
s51434__mixnmatch_large_catalogs_p
s51434mixnmatch_p
s51454TemplateParamBot_p
s51782__data_p
s51816krakenbase_p
s51886validator_p
s51892_toolserverdb_p
s51999distributed_game_p
s52164worldadmin98_p
s52229wlmuk_p
s52355wikisoba_p
s52380__metamine_p
s52421commonsdelinquent_p
s52469clickstream_p
s52475__wpx_p
s52507costar_p
s52515querylog_p
s52532__listeria_p
s52561wsexport_p
s52680science_source_p
s52680sourcemd_batches_p
s52680sourcemd_game_p
s52680sourcemd_orcid_p
s52688wits_p
s52709__kian_p
s52781wd_p
s52832every_p
s52861__bwAPI_p
s52872derechoavoto_p
s52946gns_p
s52961__WAKT_p
s52964missingpages_p
s52973alvarowiki_p
s53017__crocodylia_p
s53069tooltranslate_p
s53096tabletop_p
s53113__wscontest_p
s53132trex_p
s53143ccm2_p
s53143__ccm_p
s53143cee_db_p
s53143estlat_p
s53143__future_p
s53143jury_p
s53143lvstats_p
s53143__meta_p
s53143mis_lists_p
s53143missing_p
s53143__npp_p
s53143reminders_p
s53143rlrl_ltgwiki_p
s53143sakartosana_p
s53143spring_p
s53143__uzwiki_p
s53143wikidays_p
s53143wmlCheck_p
s53220__quickstatements_p
s53343comprende_p
s53463actrial_p
s53610__orpheus_p
s53704toolflow_p
s53734toolviews_p
s53812__topicmatcher_p
s53815wiki_fb_p
s53821test_index_p
s53844heritage_p
s53865wdpv_p
s53867__referee_p
s53910wikicite_dashboard_p
s53917npp_p
s53929__ccm_p
s53952freebase_p
s53957dev_p
s54020wsexport_test_p
s54023projector_p
s54062booster_p
toollabs_p
u1092_epsg_p
u13367templatetiger_p
u15513__booster_p
u16664wdcm_p
u2362wikidata_humans_p
u2815p
u2815rdp
+---------------------------------------+ 117 rows in set (0.12 sec)

MariaDB [(none)]> MariaDB [(none)]> show tables; ERROR 1046 (3D000): No database selected MariaDB [(none)]> show databases; +---------------------------------------+ Database
+---------------------------------------+ information_schema
s51071templatetiger_p
s51072__internallinks_p
s51075flickrfree_p
s51080checkwiki_p
s51100wp10_p
s51100_mass_translate_p
s51111common_p
s51138heritage_p
s51172ilc_p
s51192__wlx_p
s51203baglama2_p
s51203inventory_p
s51205__terminator_p
s51211duplicity_p
s51211feed_p
s51211__ib2_p
s51211monitor_p
s51211pagepile_p
s51211__sourcerer_p
s51211uk_grade2_p
s51211wikidata_cache_p
s51211wikidata_merge_by_id_p
s51218wdfist_p
s51290__dpl_p
s51296huwiki_p
s51306copyright_p
s51330__copyvios_p
s51334enwiki_first_page_revisions_p s51402commonsedge_p
s51415__stations_p
s51430bswiki_first_page_revisions_p s51434mixnmatch2015_p
s51434__mixnmatch_large_catalogs_p
s51434mixnmatch_p
s51454TemplateParamBot_p
s51782__data_p
s51816krakenbase_p
s51886validator_p
s51892_toolserverdb_p
s51999distributed_game_p
s52164worldadmin98_p
s52229wlmuk_p
s52355wikisoba_p
s52380__metamine_p
s52421commonsdelinquent_p
s52469clickstream_p
s52475__wpx_p
s52507costar_p
s52515querylog_p
s52532__listeria_p
s52561wsexport_p
s52680science_source_p
s52680sourcemd_batches_p
s52680sourcemd_game_p
s52680sourcemd_orcid_p
s52688wits_p
s52709__kian_p
s52781wd_p
s52832every_p
s52861__bwAPI_p
s52872derechoavoto_p
s52946gns_p
s52961__WAKT_p
s52964missingpages_p
s52973alvarowiki_p
s53017__crocodylia_p
s53069tooltranslate_p
s53096tabletop_p
s53113__wscontest_p
s53132trex_p
s53143ccm2_p
s53143__ccm_p
s53143cee_db_p
s53143estlat_p
s53143__future_p
s53143jury_p
s53143lvstats_p
s53143__meta_p
s53143mis_lists_p
s53143missing_p
s53143__npp_p
s53143reminders_p
s53143rlrl_ltgwiki_p
s53143sakartosana_p
s53143spring_p
s53143__uzwiki_p
s53143wikidays_p
s53143wmlCheck_p
s53220__quickstatements_p
s53343comprende_p
s53463actrial_p
s53610__orpheus_p
s53704toolflow_p
s53734toolviews_p
s53812__topicmatcher_p
s53815wiki_fb_p
s53821test_index_p
s53844heritage_p
s53865wdpv_p
s53867__referee_p
s53910wikicite_dashboard_p
s53917npp_p
s53929__ccm_p
s53952freebase_p
s53957dev_p
s54020wsexport_test_p
s54023projector_p
s54062booster_p
toollabs_p
u1092_epsg_p
u13367templatetiger_p
u15513__booster_p
u16664wdcm_p
u2362wikidata_humans_p
u2815p
u2815rdp

Also there is the issue that the previous developer was using dewiki_p DB in the code.

tobijat commented 5 years ago

@dev-ckln exactly, you won't get access to the production live databases for obvious reasons. however, you get read-access to the replicas which contain the same data except for private user data. if you need your own database (that's what I understand you want, right?), I just tried and managed to do the following: become mitmachen mysql --defaults-file=replica.my.cnf -h tools.db.svc.eqiad.wmflabs //connects to the DB server using the credentials stored in replica-my.cnf create database s53772__mitmachen_p; //this seems to be the naming convention for custom user databases according to the list you've posted quit; mysql --defaults-file=replica.my.cnf -h tools.db.svc.eqiad.wmflabs s53772__mitmachen_p //connecting to the DB server using the newly created DB create table test_table(test_column string); //creates a new table with one column show tables; //shows my newly created table

Hope that helps.

tobijat commented 5 years ago

Also there is the issue that the previous developer was using dewiki_p DB in the code.

why is that an issue?

dev-ckln commented 5 years ago

@tobijat Yes we need to store some new data, we need tables for that. From what I understand, you have created a new Database that would mean that our application would need to connect to 2 different databases. Is that correct?

tobijat commented 5 years ago

@dev-ckln exactly. You need to connect to the replica(s) (can also be more than one DB, depending on which data you need) to get the data you need in order to run the application (e.g. category data, etc..). And you need to connect to your custom database in case you want to store and retrieve custum data.

tobijat commented 5 years ago

@dev-ckln depending on what exactly you want to store in the custom database, you might consider using some alternative data structure. e.g. for a simple count, a text file might be enough..

dev-ckln commented 5 years ago

I have implemented the tracking at the tool end

dev-ckln commented 5 years ago

So now we're tracking - search entered, which results users' clicks, which suggest category user clicks.

ChristineDomgoergen commented 5 years ago

@dev-ckln @NewMonday How can we test the tracking and how do we get access to the data?

dev-ckln commented 5 years ago

@ChristineDomgoergen We are saving this information in one of tables in our database. But it's not being shown on frontend anywhere.

NewMonday commented 5 years ago

@dev-ckln and how do we get access to the data/ the table in your database?

ChristineDomgoergen commented 5 years ago

@dev-ckln @tobijat Hi Deepak, we would need access to the data not in a developed frontend but a simple URL would be good, where we can access this data:

page views: should be stored daily and there should be the possibility to select the time span, for which then the page views will be shown
interaction parameters: per month aggregated number of users who click on article preview, on the links in the help panel, the direct links to the article
time span: how long do users stay in the tool: aggregated by duration
terms entered into the search field: aggregated by term, total numbers

ChristineDomgoergen commented 5 years ago

@dev-ckln @darionewmonday This has no priority for the launch tomorrow. Please tag me as soon as you have an update on this!

darionewmonday commented 5 years ago

@ChristineDomgoergen the tracking was included in the initial offer. The request to display the data in a custom way, as per your request, can take days of development, thus we need to discuss the effort and evaluate the best way to get you the data. @dev-ckln can you provide us with an estimation, to get the features @ChristineDomgoergen is asking for? thanks

ChristineDomgoergen commented 5 years ago

@dev-ckln @darionewmonday is there any update on this? I would like to know:

How can we get access to the data right now? (included in the initial offer)
How much time would it take to get the display features requested?

darionewmonday commented 5 years ago

@ChristineDomgoergen sure, we´re checking this right now.

dev-ckln commented 5 years ago

@ChristineDomgoergen @darionewmonday We have some questions here:

Does the page views need to be in table with date range filter? or something else? Per month aggregated users should be graph or something else? Same for link clicks and search terms.

Can you please clarify here.

ChristineDomgoergen commented 5 years ago

@dev-ckln Hi Deepak, yes the page views should be displayed with date range filter, so we can sort for certain search terms. About interaction parameters: per month aggregated number of users who click on article preview, on the links in the help panel, the direct links to the article --> can be a graph or just a number.

dev-ckln commented 5 years ago

@darionewmonday @ChristineDomgoergen Okay understood, I'll see what kind of page I can make

darionewmonday commented 5 years ago

@dev-ckln please wait until we get a confirmation from Christine.

ChristineDomgoergen commented 5 years ago

@darionewmonday @dev-ckln Hi thanks for answering no 2. For comparison I would need info on no 1 as well:

How can we get access to the data right now? (included in the initial offer)

dev-ckln commented 5 years ago

@ChristineDomgoergen The data is in the DB, Its in initial offer and we're not asking for anything. But we never discussed about how to show data(layout) so don't know about that only.

dev-ckln commented 5 years ago

@ChristineDomgoergen @darionewmonday Once you approve the estimate, let me know

dev-ckln commented 5 years ago

@ChristineDomgoergen

Here are the command to be executed in order

ssh into the server
Connect to DB instance mysql --defaults-file=replica.my.cnf -h tools.db.svc.eqiad.wmflabs
Type the following to use the following DB use s53772__mitracking_p;
You can type the following to see which tables are in the DB SHOW tables;
The tracking data is stored in tracking table, you can view data by SELECT * FROM tracking LIMIT 10;

This will show 10 rows but you can increase the number. Also if you want to see full data, you can type SELECT * FROM tracking;

You can see from data the there is type column which defines what kind of type data is stored search shows search queries typed and how many times similarly subcategoryarticle shows which subcategory is clicked and how many times.

Note: All sql queries need to have ; at the end otherwise it will show error.

darionewmonday commented 5 years ago

@ChristineDomgoergen a present from us (free of charge) https://tools.wmflabs.org/mitmachen/stats

Hope is ok.

ChristineDomgoergen commented 5 years ago

@darionewmonday Great, this looks good for the search terms! Can we also see the page views somehow?

darionewmonday commented 5 years ago

@ChristineDomgoergen I assume so. I need to check how long would it take. Can you have access to some budget?

ChristineDomgoergen commented 5 years ago

@darionewmonday Depends on the amount, but it would be possible, yes.

darionewmonday commented 5 years ago

@ChristineDomgoergen ok. Can you close this ticket then, and open a new one?

wmde / mitmachen

DEV: Make tracking information available #17