demarches-normaliennes/app/jobs
simon lehericey f0b0e7fd9a Switch to usage of zip unix binary to create archive. Also use a dedicated queue for DelayedJob
use dedicated archives queue

As the used disk space will increase, we want a fined grain control

move zip logic in dedicated method

zip

wip

wip

fix(spec): pass spec in green

tech(improvements): avoid File.delete(folder), favor FileUtils.remove_entry_secure which is safer. Also wrap most of code that open file within blocks so it is cleaned when the block ends. Lastly use  attachement.download to avoid big memory pressure [download in chunk, write in chunk] otherwise big file [124>1GO] are loaded in memory. what if we run multiple jobs/download in parallel ?

fix(spec): try to retry with grace

clean(procedure_archive_service_spec.rb): better retry [avoid to rewrite on open file]

lint(things): everything
2021-12-13 16:37:04 +01:00
..
api_entreprise zeitwerk: Api -> API 2021-02-09 13:07:30 +01:00
cron fix(dossier): fix dossier.avis cascade 2021-10-26 11:16:29 +02:00
application_job.rb jobs: extract an RetryOnTranscientErrors concern 2021-04-29 14:08:12 +02:00
archive_creation_job.rb Switch to usage of zip unix binary to create archive. Also use a dedicated queue for DelayedJob 2021-12-13 16:37:04 +01:00
champ_fetch_external_data_job.rb Try to reduce the number of external data fetches 2021-03-11 14:56:37 +01:00
dossier_rebase_job.rb feat(revisions): rebase dossiers brouillons 2021-10-20 17:26:09 +02:00
etablissement_update_job.rb zeitwerk: Api -> API 2021-02-09 13:07:30 +01:00
export_job.rb discard expert not found job error 2021-10-04 12:57:37 +02:00
pipedrive_accepts_deals_job.rb [Fix #1736] Assign the deal and person to the person who accepted them 2018-06-07 16:04:15 +02:00
pipedrive_refuses_deals_job.rb [Fix #1736] Assign the deal and person to the person who accepted them 2018-06-07 16:04:15 +02:00
titre_identite_watermark_job.rb active_storage: refactor concerns 2021-03-16 11:49:14 +01:00
virus_scanner_job.rb add the good retry_on StaleObjectError 2021-11-05 13:32:21 +01:00
web_hook_job.rb Run jobs in named queues 2020-09-23 08:22:17 +02:00