[Wikimetrics] timeouts when creating large cohorts and reports

[Amanda Bittaker]

Hello again Dan and Marcel,

I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.

Could you please fix it again?

Many thanks,
Amanda

*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally

[Kevin Leduc]

Hi Amanda,

I logged a high priority issue in Phabricator for this
https://phabricator.wikimedia.org/T87596

The developers are currently at MWDS, presenting in the morning and meeting
in the afternoon. We can't jump on this immediately, but it's on our radar
and I hope we'll find time today to fix it.

-Kevin

Post by Amanda Bittaker
Hello again Dan and Marcel,
I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.
Could you please fix it again?
Many thanks,
Amanda
*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally

[Nuria Ruiz]

Update on this for the list:

Wikimetrics was having problems connecting to the labs db, a restart
"seems" to have fixed the issue but I suspect we shall see it happening
again. We shall work with ops to see if there is work that needs to happen
on our end after the configuration changes regarding the labs db hosts.

Thanks,

Nuria

Post by Kevin Leduc
Hi Amanda,
I logged a high priority issue in Phabricator for this
https://phabricator.wikimedia.org/T87596
The developers are currently at MWDS, presenting in the morning and
meeting in the afternoon. We can't jump on this immediately, but it's on
our radar and I hope we'll find time today to fix it.
-Kevin

Post by Amanda Bittaker
Hello again Dan and Marcel,
I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.
Could you please fix it again?
Many thanks,
Amanda
*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally

_______________________________________________
Wikimetrics mailing list
https://lists.wikimedia.org/mailman/listinfo/wikimetrics

[Nuria Ruiz]

Team:

I see connection errors again so definitely some environmental issue
regarding the db is going on.

Sorry about that.

Nuria

Post by Nuria Ruiz
Wikimetrics was having problems connecting to the labs db, a restart
"seems" to have fixed the issue but I suspect we shall see it happening
again. We shall work with ops to see if there is work that needs to happen
on our end after the configuration changes regarding the labs db hosts.
Thanks,
Nuria

Post by Kevin Leduc
Hi Amanda,
I logged a high priority issue in Phabricator for this
https://phabricator.wikimedia.org/T87596
The developers are currently at MWDS, presenting in the morning and
meeting in the afternoon. We can't jump on this immediately, but it's on
our radar and I hope we'll find time today to fix it.
-Kevin

Post by Amanda Bittaker
Hello again Dan and Marcel,
I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.
Could you please fix it again?
Many thanks,
Amanda
*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally

_______________________________________________
Wikimetrics mailing list
https://lists.wikimedia.org/mailman/listinfo/wikimetrics