Commit graph

357 commits

Author SHA1 Message Date
Colin Darie
c48ad8c003
fix(job): missed changed queues 2024-10-10 11:24:01 +02:00
mfo
fc37bbaa4a
Merge pull request #10906 from mfo/US/reword-queueing
amelioration : ETQ operateur j'aimerais simplifier/optimiser la gestion des tâches asynchrones
2024-10-10 07:47:59 +00:00
mfo
b8b727f06b
feat(default.queues): mailers that are not critical are low, otherwise critical. analysis is default, purge is low 2024-10-10 09:31:20 +02:00
mfo
02590b3a73
Revert "clean(delayed_jobs): remove dependencies and all occurences"
This reverts commit 90ca937b7131575816d72e35e2c48f9d82e9a5e6.

ReRevert me in order to remove all delayed job occurences. But we keep
this dependencie for our instances at least for a year
2024-10-08 16:44:09 +02:00
mfo
5eec93bc8c
clean(delayed_jobs): remove dependencies and all occurences 2024-10-08 16:43:57 +02:00
mfo
ab8ac78ccb
tech(sidekiq): use sidekiq by default, clean transition code 2024-10-08 16:43:57 +02:00
mfo
afe98704e9
feat(async): re-order priority jobs 2024-09-24 21:35:00 +02:00
mfo
08ec45443d
BREAKING(sidekiq.queues): rationalize queues. now have critical, default, low
Dear instances, make sure to update your sidekiq processes. Indead, we are adopting a new strategy for daemons that process our background
jobs.

Now their is only 3 queues on sidekiq (still, we keep archive/export on delayed job for now).

The big idea : allow any worker to deal with any queue (capacity mgmt) :
- critical: must be procesed now
- default: will be processed asap
- low: do it after everything else

FYI: we had 50% of our server capacity on reserved queues. Leading to
bottle neck processing (reserved queues/worker not processing other
queues). We HAD TO fix it. Sorry for the inconvenience

TBH, this is an idea of Colin Darie <colin@darie.eu>. I'm just pushing
it forward.

Co-Authored-By: Colin Darie <colin@darie.eu>
2024-09-24 21:29:11 +02:00
mfo
ee19268720
fix(typo): mailerS 2024-09-24 11:24:02 +02:00
mfo
0cfa9d6719
fix(batch): this is a hotfix, please be nice we just want to allow our
infra to deal with BatchOperation when their is a big load
2024-09-24 09:34:37 +02:00
Eric Leroy-Terquem
37a018880b
chore: generate representations coming from ActionText in background 2024-08-30 16:37:19 +02:00
Eric Leroy-Terquem
0511a84abf
chore: move uninterlace to image processor job 2024-08-30 14:28:43 +02:00
Colin Darie
77fb0553fc
chore: enable freeze string literals by comment 2024-08-22 09:26:48 +02:00
Colin Darie
c2159ca0bf
fix(contact): allow deletion of contact form of users having dossiers 2024-08-01 19:44:44 +02:00
Colin Darie
3469527637
fix(contact): use user email when no email was specified 2024-08-01 16:43:28 +02:00
Colin Darie
5af32b46f4
refactor(contact): form is persisted in db before pushed to HS 2024-07-31 17:08:01 +02:00
Colin Darie
ff62e99e7b
refactor(contact): suggest email correction, strict email validation, fix admin form 2024-07-31 11:23:17 +02:00
Paul Chavard
229483d16c
refactor(champ): remove type_de_champ_id and champ factories 2024-07-22 13:53:45 +02:00
simon lehericey
7c1b26930b
tech: move cron tab to specific time 2024-06-21 17:15:01 +02:00
Colin Darie
a1469b04fe
refactor(support): create HS conversation in async and run virus scanner on attachments 2024-06-13 13:27:51 +02:00
Eric Leroy-Terquem
f6e54a540b
chore(gallery): add activestorage error catching in job 2024-06-06 12:01:42 +02:00
Eric Leroy-Terquem
05ad5dcbd6
feat(gallery): display large variant for rare image types 2024-06-06 12:01:40 +02:00
simon lehericey
bcf3c0ff34
fix(jobs): fix default bulk_email_queue name 2024-05-30 10:24:52 +02:00
Colin Darie
eaf9773e9e
chore(job): DossierIndexSearchTerms in low_priority queue 2024-05-27 09:55:24 +02:00
Colin Darie
c2b1d7aaaf
Merge pull request #10261 from colinux/ignore-search-terms-2
Tech (perf): ignore les `search_terms` colonnes pour ne plus les select à chaque query et debounce l'indexation
2024-05-21 07:07:10 +00:00
Lisa Durand
affb1820d8
add PDF preview in view for gallery 2024-05-17 11:03:39 +02:00
Lisa Durand
93c3761107
add specs 2024-05-17 11:03:39 +02:00
Lisa Durand
b4a7b4bfbd
create a job for all image treatments 2024-05-17 11:03:38 +02:00
Colin Darie
1615b8ea28
chore(export): set sentry tag procedure id 2024-05-13 14:01:43 +02:00
Colin Darie
39b0327237
refactor(search): rename update search terms => index search terms 2024-05-06 18:57:39 +02:00
Colin Darie
2e763d5e92
perf(search): ignore search_terms columns, use raw sql instead 2024-05-06 17:16:34 +02:00
simon lehericey
a10a59b265
perf: only load id digest 2024-04-19 08:48:17 +02:00
simon lehericey
8f8b63ac6a
fix: load the dols day by day 2024-04-19 08:48:17 +02:00
simon lehericey
21e8fc54e2
chore: put dol_to_cold_storage back to low_priority 2024-04-18 17:10:21 +02:00
simon lehericey
2f946c1592
refactor: put dol cold storage migration to its own queue 2024-04-16 13:48:12 +02:00
Paul Chavard
bde496b739
Merge pull request #10322 from tchak/chore-backfill-stable-id-custom-limit
chore(task): backfill stable_id with custom limit
2024-04-15 09:28:21 +00:00
Paul Chavard
ef2aa217ff chore(task): backfill stable_id with custom limit 2024-04-15 10:43:39 +02:00
simon lehericey
d419508b68
fix: reduce a join query size 2024-04-15 10:34:39 +02:00
Paul Chavard
4cdaef3a08
Merge pull request #10300 from tchak/chore-stable_id-task
fix(stable_id): recursive job to fill stable_ids
2024-04-11 09:53:56 +00:00
Paul Chavard
9bfc4119b1 fix(stable_id): recursive job to fill stable_ids 2024-04-11 11:45:03 +02:00
simon lehericey
34fae2831f
refactor: add dol_move_batch job which are enqueued by the cron 2024-04-11 10:58:34 +02:00
Colin Darie
dfbe53dcc5
fix(cron): really schedule jobs on sidekiq instead of running them 2024-04-10 18:03:47 +02:00
Colin Darie
25892f594c
fix(jobs): don't enqueue crons to default adapter anymore 2024-04-08 18:27:31 +02:00
LeSim
12406643d9
Merge pull request #10268 from demarches-simplifiees/sidekiq_cron
Tech: déplace les cron job sur sidekiq
2024-04-08 08:32:06 +00:00
simon lehericey
ac695a2151
fix: discard DeserializationError on fetch external data job 2024-04-05 10:42:44 +02:00
Paul Chavard
282ce1322c fix(stats): more accurat stats about deleted dossiers 2024-04-04 19:00:48 +02:00
Paul Chavard
81c325f938 chore(task): another attempt to backfill stable_id 2024-04-04 17:55:38 +02:00
simon lehericey
42af5a9149
make cron_job work with both delayed_job and sidekiq 2024-04-04 16:38:38 +02:00
simon lehericey
dd6c558541
fix: discard deserialization error as there are raised from AR not found 2024-04-02 10:00:06 +02:00
mfo
fd5faad31f
fix(Champs::PaysChamp): validates Champs::PaysChamp respecting it's validation context. Also do not save value when external_id/code can't be found by lookup 2024-04-01 07:18:13 +02:00