Super slow once a lot of data

Created on 29 November 2022, over 2 years ago

Updated 15 September 2024, 7 months ago

Problem/Motivation

I am seeing a really delayed response time in votes now that we have millions of them. I believe it's related to the rate bot function.

MYSQL Slow Queries is showing a lot of the following which I believe to be the issue since there's no index on the vote source:
SELECT COUNT(*) FROM "votingapi_vote" WHERE vote_source = '0.0.0.0' AND timestamp > '1669759063';

Proposed resolution

- Add an index to the table for `vote_source`

🐛 Bug report

Status

Closed: cannot reproduce

Version

3.0

Component

Code

Created by

🇨🇦Canada b_sharpe

Live updates comments and jobs are added and updated live.

Incomplete comments

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

Comment almost 2 years ago →
🇦🇹Austria jordik
The 'vote_source' is a hash indeed. Details on this can be found here, it is due to GDPR: #2974084: Anonymize IP address data to meet EU (GDPR) data protection regulations → .

As for the performance - Rate is using Voting API → to store and retrieve the votes. If the problem is solved by adding an index (please confirm), then this issue needs to be in the Voting API issue queue.
Status changed to Closed: cannot reproduce 7 months ago9:00am 15 September 2024
Comment 7 months ago →
ivnish Kazakhstan

contrib.social Blog FAQ Discussions

Production build 0.71.5 2024