mfo
eee9efd52e
Merge pull request #10907 from mfo/reschedule_dossier_operation_log_move_to_cold_storage_job
...
ETQ tech, je souhaite que les jobs asynchrone pour deplacer les objets dans le stockage à froid se fassent en pleinne nuit
2024-10-10 09:33:43 +00:00
Colin Darie
c48ad8c003
fix(job): missed changed queues
2024-10-10 11:24:01 +02:00
mfo
d729c2f193
tech(perf): reschedule this job at 4am when our workers does not do anything
2024-10-10 11:21:05 +02:00
mfo
fc37bbaa4a
Merge pull request #10906 from mfo/US/reword-queueing
...
amelioration : ETQ operateur j'aimerais simplifier/optimiser la gestion des tâches asynchrones
2024-10-10 07:47:59 +00:00
mfo
b8b727f06b
feat(default.queues): mailers that are not critical are low, otherwise critical. analysis is default, purge is low
2024-10-10 09:31:20 +02:00
mfo
02590b3a73
Revert "clean(delayed_jobs): remove dependencies and all occurences"
...
This reverts commit 90ca937b7131575816d72e35e2c48f9d82e9a5e6.
ReRevert me in order to remove all delayed job occurences. But we keep
this dependencie for our instances at least for a year
2024-10-08 16:44:09 +02:00
mfo
5eec93bc8c
clean(delayed_jobs): remove dependencies and all occurences
2024-10-08 16:43:57 +02:00
mfo
ab8ac78ccb
tech(sidekiq): use sidekiq by default, clean transition code
2024-10-08 16:43:57 +02:00
mfo
afe98704e9
feat(async): re-order priority jobs
2024-09-24 21:35:00 +02:00
mfo
08ec45443d
BREAKING(sidekiq.queues): rationalize queues. now have critical, default, low
...
Dear instances, make sure to update your sidekiq processes. Indead, we are adopting a new strategy for daemons that process our background
jobs.
Now their is only 3 queues on sidekiq (still, we keep archive/export on delayed job for now).
The big idea : allow any worker to deal with any queue (capacity mgmt) :
- critical: must be procesed now
- default: will be processed asap
- low: do it after everything else
FYI: we had 50% of our server capacity on reserved queues. Leading to
bottle neck processing (reserved queues/worker not processing other
queues). We HAD TO fix it. Sorry for the inconvenience
TBH, this is an idea of Colin Darie <colin@darie.eu>. I'm just pushing
it forward.
Co-Authored-By: Colin Darie <colin@darie.eu>
2024-09-24 21:29:11 +02:00
mfo
ee19268720
fix(typo): mailerS
2024-09-24 11:24:02 +02:00
mfo
0cfa9d6719
fix(batch): this is a hotfix, please be nice we just want to allow our
...
infra to deal with BatchOperation when their is a big load
2024-09-24 09:34:37 +02:00
Eric Leroy-Terquem
37a018880b
chore: generate representations coming from ActionText in background
2024-08-30 16:37:19 +02:00
Eric Leroy-Terquem
0511a84abf
chore: move uninterlace to image processor job
2024-08-30 14:28:43 +02:00
Colin Darie
77fb0553fc
chore: enable freeze string literals by comment
2024-08-22 09:26:48 +02:00
Colin Darie
c2159ca0bf
fix(contact): allow deletion of contact form of users having dossiers
2024-08-01 19:44:44 +02:00
Colin Darie
3469527637
fix(contact): use user email when no email was specified
2024-08-01 16:43:28 +02:00
Colin Darie
5af32b46f4
refactor(contact): form is persisted in db before pushed to HS
2024-07-31 17:08:01 +02:00
Colin Darie
ff62e99e7b
refactor(contact): suggest email correction, strict email validation, fix admin form
2024-07-31 11:23:17 +02:00
Paul Chavard
229483d16c
refactor(champ): remove type_de_champ_id and champ factories
2024-07-22 13:53:45 +02:00
simon lehericey
7c1b26930b
tech: move cron tab to specific time
2024-06-21 17:15:01 +02:00
Colin Darie
a1469b04fe
refactor(support): create HS conversation in async and run virus scanner on attachments
2024-06-13 13:27:51 +02:00
Eric Leroy-Terquem
f6e54a540b
chore(gallery): add activestorage error catching in job
2024-06-06 12:01:42 +02:00
Eric Leroy-Terquem
05ad5dcbd6
feat(gallery): display large variant for rare image types
2024-06-06 12:01:40 +02:00
simon lehericey
bcf3c0ff34
fix(jobs): fix default bulk_email_queue name
2024-05-30 10:24:52 +02:00
Colin Darie
eaf9773e9e
chore(job): DossierIndexSearchTerms in low_priority queue
2024-05-27 09:55:24 +02:00
Colin Darie
c2b1d7aaaf
Merge pull request #10261 from colinux/ignore-search-terms-2
...
Tech (perf): ignore les `search_terms` colonnes pour ne plus les select à chaque query et debounce l'indexation
2024-05-21 07:07:10 +00:00
Lisa Durand
affb1820d8
add PDF preview in view for gallery
2024-05-17 11:03:39 +02:00
Lisa Durand
93c3761107
add specs
2024-05-17 11:03:39 +02:00
Lisa Durand
b4a7b4bfbd
create a job for all image treatments
2024-05-17 11:03:38 +02:00
Colin Darie
1615b8ea28
chore(export): set sentry tag procedure id
2024-05-13 14:01:43 +02:00
Colin Darie
39b0327237
refactor(search): rename update search terms => index search terms
2024-05-06 18:57:39 +02:00
Colin Darie
2e763d5e92
perf(search): ignore search_terms columns, use raw sql instead
2024-05-06 17:16:34 +02:00
simon lehericey
a10a59b265
perf: only load id digest
2024-04-19 08:48:17 +02:00
simon lehericey
8f8b63ac6a
fix: load the dols day by day
2024-04-19 08:48:17 +02:00
simon lehericey
21e8fc54e2
chore: put dol_to_cold_storage back to low_priority
2024-04-18 17:10:21 +02:00
simon lehericey
2f946c1592
refactor: put dol cold storage migration to its own queue
2024-04-16 13:48:12 +02:00
Paul Chavard
bde496b739
Merge pull request #10322 from tchak/chore-backfill-stable-id-custom-limit
...
chore(task): backfill stable_id with custom limit
2024-04-15 09:28:21 +00:00
Paul Chavard
ef2aa217ff
chore(task): backfill stable_id with custom limit
2024-04-15 10:43:39 +02:00
simon lehericey
d419508b68
fix: reduce a join query size
2024-04-15 10:34:39 +02:00
Paul Chavard
4cdaef3a08
Merge pull request #10300 from tchak/chore-stable_id-task
...
fix(stable_id): recursive job to fill stable_ids
2024-04-11 09:53:56 +00:00
Paul Chavard
9bfc4119b1
fix(stable_id): recursive job to fill stable_ids
2024-04-11 11:45:03 +02:00
simon lehericey
34fae2831f
refactor: add dol_move_batch job which are enqueued by the cron
2024-04-11 10:58:34 +02:00
Colin Darie
dfbe53dcc5
fix(cron): really schedule jobs on sidekiq instead of running them
2024-04-10 18:03:47 +02:00
Colin Darie
25892f594c
fix(jobs): don't enqueue crons to default adapter anymore
2024-04-08 18:27:31 +02:00
LeSim
12406643d9
Merge pull request #10268 from demarches-simplifiees/sidekiq_cron
...
Tech: déplace les cron job sur sidekiq
2024-04-08 08:32:06 +00:00
simon lehericey
ac695a2151
fix: discard DeserializationError on fetch external data job
2024-04-05 10:42:44 +02:00
Paul Chavard
282ce1322c
fix(stats): more accurat stats about deleted dossiers
2024-04-04 19:00:48 +02:00
Paul Chavard
81c325f938
chore(task): another attempt to backfill stable_id
2024-04-04 17:55:38 +02:00
simon lehericey
42af5a9149
make cron_job work with both delayed_job and sidekiq
2024-04-04 16:38:38 +02:00