Commit graph

688 commits

Author SHA1 Message Date
Colin Darie
83a3421537
Merge pull request #8769 from colinux/fix-annotations-privees-champ-type-mismatch
Fix: crash d'annotations privées à cause d'une incohérence avec leur type de champ
2023-03-16 15:55:56 +00:00
simon lehericey
ca63cc34ab feat(token depreciation): add mail alert 2023-03-16 16:16:45 +01:00
Colin Darie
4ae18af3cd
fix(annotations-privees): mismatch Champ.type <> TypeDeChamp.type_champ due to buggy rebases 2023-03-16 14:52:12 +01:00
Colin Darie
08666cd852 fix(dossier): fix again hidden_by_reason nil to fix Cron::DiscardedDossiersDeletionJob 2023-03-02 17:16:52 +01:00
Christophe Robillard
6851a9ee52 falsify opendata flag for some procedures
`procedures:falsify_opendata_procedures` rake task allows to falsify
opndata flag for procedures listed in csv file given in input (with only
one column : id column)
2023-03-01 11:47:11 +01:00
Colin Darie
ce175aed00 chore(type_de_champ): normalize (strip) all libelles 2023-02-27 17:29:22 +01:00
Christophe Robillard
61d14c2c52 compute once dossiers count for each procedure 2023-02-21 10:06:07 +01:00
Martin
437be2c901 correctif(data): supprime les attachment sans blob 2023-02-16 14:54:13 +01:00
Paul Chavard
f6b528e497 chore(geo_area): normalize all geo_areas 2023-02-15 11:58:59 +01:00
sebastiencarceles
daa7e17e70 review: avoid in_batches 2023-02-13 16:32:34 +01:00
sebastiencarceles
f0ffae8320 migrate(champs): normalize departements 2023-02-13 16:32:34 +01:00
mfo
e0da997a9b
Merge pull request #8593 from demarches-simplifiees/migration/normalize-regions
migrate(champs): normalize regions
2023-02-13 09:22:34 +01:00
Paul Chavard
e3446c2ad1 fix(revision): backfill missing published_at 2023-02-09 11:52:41 +01:00
sebastiencarceles
d2f5fe5ff5 migrate(champs): normalize regions 2023-02-09 10:46:17 +01:00
Colin Darie
2c1465a8cc
fix(geo_area): geo_area.geometry must be valid JSON, not nil 2023-02-08 16:55:35 +01:00
Martin
14494255be Revert "migrate(champs): normalize departements (#8505)"
This reverts commit 6800bb8cec.
2023-02-06 15:57:26 +01:00
Martin
db36397bc5 Revert "migration: normalize regions (#8521)"
This reverts commit 8fee658eba.
2023-02-06 14:49:51 +01:00
Martin
54fa4ddc3d data(migration): renomme les anciennes method dolist en dolist_smtp 2023-02-03 17:19:36 +01:00
Colin Darie
b0b7114c3b
feat: jsv support for primitives 2023-02-02 14:55:46 +01:00
Sébastien Carceles
8fee658eba
migration: normalize regions (#8521) 2023-02-02 10:19:33 +00:00
Sébastien Carceles
6800bb8cec
migrate(champs): normalize departements (#8505)
* migration: normalize departements

* rename update_all methods to avoid collusions

* simplify scopes
2023-02-02 10:00:56 +00:00
Paul Chavard
dd2d3d4626 fix(task): improuve after party backfill_dossiers_repetitions 2023-02-01 15:27:07 +01:00
Paul Chavard
8bf0d9c5ec fix(dossier): backfill missing repetition champs 2023-02-01 10:36:46 +01:00
Martin
bf839d61a0 amelioration(data): re-associe les anciennes invitation avec un nouveau targeted_user_link pour concerver des données homogènes 2023-01-31 17:09:36 +01:00
Martin
70e3d5a30c correctif(invitations): reprise des donnees d'invitations en erreur pointant sur le mauvais model 2023-01-31 16:55:12 +01:00
Martin
f6aa30763a donnees(correctif): corrige les transfers de dossiers ayant un email contenant des lettres capitales 2023-01-31 14:52:57 +01:00
Paul Chavard
626b28ca16 perf(tags parser): improuve parser perf 2023-01-30 11:52:35 +01:00
Colin Darie
869bdf6ade fix(after_party): backfill children Champs without row_ids
Pendant l'after_party 20221215135522_backfill_row_id_on_champs.rake
qui crééait les row_id pour la première fois,
des dossiers ont été clonés et ont échappé à cette tâche.
Ils possèdent donc des champs répétables sans row_id.

Cette tâche vient compléter les row_id manquants
pour ces quelques malheureux champs.

Co-authored-by: Paul Chavard <github@paul.chavard.net>
2023-01-18 17:42:40 +01:00
Damien Le Thiec
3a8a50a216
Allow prefill pays type de champs (#8344)
* Allow prefill pays type de champs

* Avoid conditional prefil params for pays champ

* Clean pays data with batch update

* Fix bug and add test batch update pays value

* Improve performance batch_update_pays

* Fix associated country code problem

* Fix after party task name

* Format country name if needed in batch update
2023-01-18 12:52:38 +01:00
Paul Chavard
bb6c53abaa fix(after_party): BatchUpdateDatetimeValueJob -> BatchUpdateDatetimeValuesJob 2023-01-17 16:40:34 +01:00
Paul Chavard
cd22f106be fix(after_party): DateTimeChamp -> DatetimeChamp 2023-01-17 16:13:59 +01:00
Damien Le Thiec
5e26acb0e1
Make date and datetime prefillable (#8304)
* Make date and datetime prefillable

* Format in ISO8601 format
2023-01-12 17:42:02 +01:00
Paul Chavard
dfe65136be refactor(repetition): add row_id to champs 2023-01-05 18:04:54 +01:00
Sébastien Carceles
fa6fc077b4
normalize boolean values (#8320)
* extract parent for yes no and checkbox champs

* checkbox stores true / false instead of on / off

* normalize blank value to nil

* normalize invalid value to false

* after party task: normalize checkbox values

* after party task: normalize yes_no values
2023-01-05 11:18:27 +00:00
Paul Chavard
6e18090fb3 refactor(virus_scan_result): use column instead of metadata on blob 2023-01-04 12:12:11 +01:00
Paul Chavard
d469bca0ae refactor(watermark): use column instead of metadata on blob 2023-01-04 12:07:08 +01:00
Colin Darie
9acde4bc61 fix(geo_area): missing source on 1 record 2022-12-21 12:57:38 +01:00
Paul Chavard
4eaa6ae049 fix(dossier): schedule a rebase to all pending dossiers 2022-12-21 10:12:33 +01:00
Christophe Robillard
11a18516b2 remove feature flag zonage 2022-12-21 09:02:16 +01:00
Paul Chavard
47f716f9fa feat(api_token): add api_tokens table 2022-12-07 18:19:37 +01:00
simon lehericey
905e3ab64e clean(flipper): remove unused gates 2022-12-05 12:22:29 +01:00
simon lehericey
f63de9524f feat(super_admin): create admin count for super_admin with team_account enabled 2022-11-24 12:22:01 +01:00
Paul Chavard
55c5de2c2c feat(attestation_template): assign attestations templates to procedures 2022-11-23 12:26:26 +01:00
simon lehericey
33dcd7a787 fix(procedure): backfill duree_conservation 2022-11-23 12:19:14 +01:00
Colin Darie
2c1e9a4fa2 chore(lint): +haml-link on app/components 2022-11-22 12:06:15 +01:00
simon lehericey
6a7621b731 feat(support): add task to remove ex team member 2022-11-16 17:52:48 +01:00
simon lehericey
fcfe09f05a refactor(user): rename delete_and_keep_track_dossiers 2022-11-16 17:52:47 +01:00
simon lehericey
b70cbf0ba1 clean(task): remove unused tasks 2022-11-16 17:52:47 +01:00
Eric Leroy-Terquem
28dfae3ed9 fix procedure with active group and routing nil 2022-11-09 14:15:59 +01:00
Eric Leroy-Terquem
7e79fc8c3b fix procedure with only inactive group 2022-11-09 13:56:00 +01:00
Martin
c9292e7ba8 amelioration(bdd): mise en place d'un flag pour identifier les anciens comptes d'admin de DS 2022-11-08 09:55:21 +01:00
Eric Leroy-Terquem
cdaaf09fd8 add after party 2022-11-04 12:03:44 +01:00
Paul Chavard
5be8810da4 fix(dossier): nullify instructeur and expert id on messages when they are deleted
we keep email on the message so it will be used when instructeur or expert are not available
2022-10-19 11:53:10 +02:00
simon lehericey
0565fa50ce fix: typo in task 2022-10-18 15:29:52 +02:00
simon lehericey
d050abe53c fix(task): add begin rescue in rake task 2022-10-18 15:05:29 +02:00
Martin
6000de2095 feat(manager/outdated_procedure): enhance procedure cleanup 2022-10-17 13:35:37 +02:00
Paul Chavard
eb5b9fd9e5 fix(iban): apply correct format to all ibans 2022-10-11 10:45:03 +02:00
Martin
202ae209a3 correctif(routing_criteria_name ne doit pas etre vide): ne pas oublier les procedures.routing_criteria_name ayant une chaine de caractère vide ex: ' ' 2022-10-11 10:23:38 +02:00
Martin
45459343a7 fix(procedure.clone): le clonage des procédure était bloqué car nous avions des données inconsistantes 2022-10-11 09:33:48 +02:00
Martin
285c7d704a fix(type_de_champ.data): drop former orphan from type_de_champ and champ without coordinates 2022-10-07 11:08:36 +02:00
Paul Chavard
432c4690b5 feat(tags): replace regexp based parser with a parser combinator 2022-10-05 11:25:37 +02:00
Martin
ba1035bd30 fix(data): remove orphaned targeted_user_links 2022-10-04 13:37:53 +02:00
Martin
17ed80b18a clean(Champs::Engagement): migrate to Champs::Checkbox, some for TypeDeChamp 2022-09-27 19:09:28 +02:00
Christophe Robillard
f846393ec0 make populate_zones an after_party task 2022-09-26 16:58:53 +02:00
Christophe Robillard
bc5ea8e906 update zones with new government 2022-09-26 16:58:53 +02:00
Martin
d9432ccd3b fix(etablissement.as_degraded_mode): backfill missing data via a cron 2022-09-23 15:12:25 +02:00
Martin
daeab50321 fix(data): backfill etablissement as degraded mode 2022-09-22 18:02:47 +02:00
Paul Chavard
3cea20c46a fix(after_party): split foreign key cleanup task 2022-09-14 11:20:35 +02:00
Paul Chavard
74c6273d17 fix(db): remove bad data 2022-09-13 12:28:04 +02:00
Martin
b9e7bdc01e fix(migration): following e764aade13 ; we still need to remove those columns otherwise destroying a procedure fails due to index on types_de_champ.revision_id 2022-08-22 16:00:56 +02:00
Colin Darie
db968a1ffc fix(db): remove DossierTransfer without email 2022-08-03 11:44:54 +02:00
Christophe Robillard
f556b39910 fix(db): remove bad attachments
destroy attachments with blobs that doesn't exist
2022-07-28 10:11:27 +02:00
Colin Darie
67d2cb2061 chore(schema): add exports#job_status
Same behavior as Archive

On destroy tous les exports existants qui n'ont pas cette notion de status.
2022-07-26 17:53:24 +02:00
Paul Chavard
03fbe506f6 perf(graphql): benchmark demarches_publiques query 2022-07-26 12:54:10 +02:00
Christophe Robillard
899047b656 schedule and display only schedulable jobs 2022-07-21 21:54:15 +02:00
Paul Chavard
8532c71036 perf(dossier.pdf): use DossierPreloader to generate pdf 2022-07-21 15:02:29 +02:00
Paul Chavard
260d8d2fec perf(graphql): add graphql benchmark 2022-07-21 12:29:08 +02:00
Martin
308bedf28a feat(task/support:delete_adminstrateurs_procedures): add task to remove all AdministrateursProcedure from a user admin 2022-07-06 14:38:04 +02:00
Paul Chavard
e9d0ccbdf9 task(dossier): remove orphan champs 2022-07-06 13:28:00 +02:00
Martin
4ef2fe37e6 fix(20220614053743_fix_procedure_presentation_with_depose_since): missed case of procedure_presentation with Mis à jour depuis 2022-06-14 17:11:20 +02:00
Paul Chavard
b6868ce9ea perf(dossier): add dossier export benchmarks 2022-06-14 09:04:26 +01:00
Martin
56f7133799 fix(procedure_presentation): can not present a 'virtual field' like depose_since
fix(data): add migration to remove fields depose_since from existing procedure presentation
2022-06-14 09:02:37 +02:00
Paul Chavard
baad32905f fix(procedure): fix wrong parents 2022-06-01 09:33:39 +02:00
Christophe Robillard
b6d0d1a101 remove old FindDubiousProceduresJob from delayed_job table 2022-05-25 14:44:53 +02:00
Martin
863358f389 clean(data): remove old cron UpdateAdministrateurUsageStatisticsJob from delayed job table 2022-05-17 16:57:55 +02:00
Martin
7fcf566382 sentry(3002560608): some Dossier ready to be purged are missing the hidden_by_reason 2022-05-16 21:18:13 +02:00
Martin
9798e268df fix(sentry/3139111475): clean up some "corrupted" data, some dossier still have depose_at nil while en_construction_at is set 2022-05-16 13:58:50 +02:00
Paul Chavard
f5a2747af7 fix(revision): add fix_child_types_de_champ task to create join tables on repetition children 2022-05-12 12:54:18 +02:00
simon lehericey
62aecd3b2e after_party: fix wrong parent 2022-05-10 13:52:58 +02:00
Martin
75da4d8c8d Revert "migration(fix.data): when a repetable revision_types_de_champ points to a non active revision type de champs, relink it to the actuel revision_type_de_champs pointing to the stable id of its parent.type_de_champ.stable_id"
This reverts commit 19360e7aac.
2022-05-09 18:45:35 +02:00
Martin
19360e7aac migration(fix.data): when a repetable revision_types_de_champ points to a non active revision type de champs, relink it to the actuel revision_type_de_champs pointing to the stable id of its parent.type_de_champ.stable_id 2022-05-09 18:01:02 +02:00
Paul Chavard
27f9a820cc feat(dossier): add preview flag 2022-04-28 11:52:38 +02:00
Paul Chavard
90dd5bc9c5 fix(dossiers): dossier extend_conservation actually works 2022-04-08 13:40:28 +02:00
simon lehericey
c00e21adb9 after_party task which removes duplicate attestation 2022-04-05 13:01:32 +02:00
Pierre de La Morinerie
6dd742dcdf db: add a data migration to remove invalid roles
This prepares a future migration where we can add database constraints
to those roles.
2022-03-29 08:30:48 +02:00
François Vantomme
04c3739a3d fix(after_party): rescue from PG::UndefinedColumn
ActiveRecord::StatementInvalid: PG::UndefinedColumn: ERROR:  column types_de_champ.procedure_id does not exist

fixes: #7036
2022-03-23 10:57:32 +01:00
François Vantomme
6a6947c064 fix(after_party): check constant presence before processing
NameError: uninitialized constant TmpDossiersMigrateRevisionsJob

refs: #7032
2022-03-22 12:07:40 +01:00
François Vantomme
a1354e7996 fix(after_party): rescue from ActiveRecord::ConfigurationError
ActiveRecord::ConfigurationError: Can't join 'TypeDeChamp' to
association named 'drop_down_list'; perhaps you misspelled it?

refs: #7030
2022-03-22 12:02:43 +01:00
François Vantomme
28f9bd62d1 fix(after_party): use find_or_create_by to respect idempotency 2022-03-17 10:10:10 +01:00
François Vantomme
021bdd4db6 fix(after_party): use find_or_create_by to respect idempotency
instead of create!
2022-03-17 10:02:43 +01:00
François Vantomme
b89541568c fix(after_party): remove APP_ENV condition 2022-03-16 17:56:06 +01:00
François Vantomme
93233be5c9 fix(after_party): add the missing second argument to send_expiration_notices method
ArgumentError: wrong number of arguments (given 1, expected 2)
app/services/expired_dossiers_deletion_service.rb:72:in `send_expiration_notices'
lib/tasks/deployment/20200401123317_process_expired_dossiers_en_construction.rake:11:in `block (2 levels) in <main>'

refs: 7028
2022-03-16 17:56:06 +01:00
Pierre de La Morinerie
1b69accd10 tasks: rename after_party task to the proper name
The name of the file must be exactly the same than the name of the
task.
2022-03-15 16:20:15 +01:00
Pierre de La Morinerie
d2f12e5188 db: copy user-related ids to the respective models 2022-03-15 15:57:22 +01:00
François Vantomme
5d448fd152 fix(export): set a random UUID key before forcing not null 2022-03-15 08:57:39 +01:00
Paul Chavard
4c567632e5 fix(migration): add with_discarded to seed_hidden_at_dossiers 2022-03-09 17:53:49 +01:00
Paul Chavard
bcbcd11c42 migrate(dossier): fill hidden_by_administration_at and hidden_by_user_at from hidden_at 2022-03-09 17:41:28 +01:00
Pierre de La Morinerie
5150e33212 models: ensure DROM phone numbers are valid
They were accepted before, because they were 'possible' – but now
they are explicitely considered as valid.
2022-03-02 09:57:03 +00:00
Pierre de La Morinerie
30d7cf634a tasks: restore older after_party tasks
Turns out deleting the tasks after 6 months only may not be enough for instances deploying
only once a year, for instance.

This reverts commit 77b65f3aa0.
2022-02-22 15:39:16 +01:00
Paul Chavard
fac77d97ef task(attestation_template): reassign_redundant_attestation_templates 2022-02-11 11:30:24 +01:00
Paul Chavard
e269077c40 refactor(attestation_template): cleanup relationships 2022-02-11 08:45:32 +01:00
Paul Chavard
ea6aec8b1a chore(webpack): enable typescript 2022-02-09 10:29:00 +01:00
Paul Chavard
1fc7db2562 fix(attestation_template): fix migration task 2022-02-08 16:22:59 +01:00
François Vantomme
284483c3db fix(task): deal nicely with nil claimant_type on avis table 2022-02-08 16:14:59 +01:00
François Vantomme
c466d225e8 fix(task): deal nicely with dropped instructeur_id column on avis table 2022-02-08 16:03:58 +01:00
Paul Chavard
0ad44bcfdb
Merge pull request #6924 from adullact/fix/6882-afterparty-backfill-claimant
[AfterParty] échec de la tâche 20210311085419_backfill_claimant_id_for_experts_on_avis_table
2022-02-08 14:58:41 +01:00
Paul Chavard
a680ceba01
Merge pull request #6925 from adullact/fix/6883-afterparty-backfill-experts-procedure
[AfterParty] échec de la tâche 20210324081552_backfill_experts_procedure_id_on_avis_table
2022-02-08 14:58:11 +01:00
Pierre de La Morinerie
847abca122 config: simplify mailer configuration again
Move everything to initializers, and replace the email settings
interceptor by a BalancerDeliveryMethod.

It has the advantage that it can be configured entirely from the
`config/environment.rb` file, without an extra file to look at.
2022-02-08 12:44:43 +01:00
Pierre de La Morinerie
04cfc8ed9d config: use alternate delivery methods to configure ActionMailer
Previously `SENDINBLUE_BALANCING` was used only when
`SENDINBLUE_ENABLED` was *disabled* (otherwise only SendInBlue was ever
used).

This commit:

- Ensure that `SENDINBLUE_BALANCING` is used only when SendInBlue is
  *enabled* (which is more intuitive).
- Make it easier to add other delivery methods.
2022-02-08 12:44:43 +01:00
Paul Chavard
537112acee
Merge pull request #6926 from adullact/fix/6884-afterparty-rename-conservation-extension
[AfterParty] échec de la tâche 20210429172327_rename_conservation_extension
2022-02-08 12:00:50 +01:00
François Vantomme
eea3087ef0
fix(task): deal nicely with dropped instructeur_id column on avis table 2022-02-04 19:12:28 +01:00
François Vantomme
efe0b307a1
fix(task): reword duplicated task name 2022-02-04 18:59:56 +01:00
François Vantomme
feabae75c6
fix(task): temporary bypass ignored en_construction_conservation_extension column on Dossier 2022-02-04 18:51:29 +01:00
François Vantomme
ab06ec2887
fix(task): deal nicely with dropped tmp_expert_migrated column on avis table 2022-02-04 18:46:16 +01:00
Paul Chavard
c25dba850e hotfix(attestation): add missing attestations on dossiers 2022-01-26 15:33:42 +01:00
Paul Chavard
80125cbed1 fix attestation templates 2022-01-25 18:43:26 +01:00
Paul Chavard
ff806782de feat(attestation): migration task to revise attestations 2022-01-19 18:00:37 +01:00
Christophe Robillard
822c754581 add namespace for populate_zones task 2021-12-16 17:20:06 +01:00
Christophe Robillard
882f92268c update zone to procedures 2021-12-16 17:20:06 +01:00
Christophe Robillard
84c648eef0 manual task for populating zones 2021-12-15 19:37:32 +01:00
Paul Chavard
a5b3bc1e79 fix(task): fix scope in set_dossiers_processed_at 2021-12-07 16:15:43 +01:00
Paul Chavard
612b3bd82d fix(task): use dossier.read_attribute instead of direct read 2021-12-07 13:36:59 +01:00
Paul Chavard
5e0f8a5816 task(type_de_champ): migrate type_de_champ parent_id 2021-12-06 21:45:54 +01:00
Martin
1bb868714c fix(spec/lint/review): lint and fix spec of previous commits, also fix based on tchak feedback 2021-12-06 07:05:17 +01:00
Martin
ce87878ff0 refactor(traitement.process_expired): move process expired to procedure 2021-12-03 16:32:36 +01:00
Christophe Robillard
5b8d872b6e populate zones 2021-12-02 19:16:11 +01:00
Pierre de La Morinerie
65c1966dc2 lib: fix after_party task name 2021-11-30 15:51:25 +01:00
Pierre de La Morinerie
103502931a tasks: populate Instructeur.bypass_email_login_token again
The task was run once in April 2021, but the new features enabled since
have not been synchronized.
2021-11-30 13:41:25 +01:00
Paul Chavard
68f6c01548 task(traitements): add depose_at to existing dossiers 2021-11-25 12:57:55 +03:00
Paul Chavard
18808358f9 fix(dossiers): add processed_at to processed dossiers 2021-11-11 09:37:09 +01:00
Paul Chavard
e4317e8c7e task(dossiers): delete MAE procedures expired dossiers 2021-11-04 10:00:26 +01:00
Paul Chavard
70c33afcfe fix(avis): remove avis without dossier 2021-10-06 18:10:55 +02:00
Pierre de La Morinerie
6271c41fef i18n: add automated check for unused locales (en only)
In a next PR we'll also check for french (and thus all locales).
2021-09-21 10:44:20 -05:00
Pierre de La Morinerie
580ae1c063 i18n: add automated check for inconsistent interpolations 2021-09-21 10:44:20 -05:00
Pierre de La Morinerie
bb4512d41e tasks: add check for missing french locales to the linter
This lint will fail if any locale defined in the code doesn't have
a french localized string.
2021-09-16 07:59:19 -05:00
Pierre de La Morinerie
9741108094 lib: remove the 'migrated' key on filters
In a9a4f6e2a8, a task to migrate
ProcedurePresentation's filters was added.

This task added a "migrated: true" key to all migrated filters.

Now that this task has run, we can safely remove the extra key.

In a previous version of this commit, the migration would fail for
invalid ProcedurePresentation records. This is now fixed.
2021-08-24 08:42:22 -05:00
Pierre de La Morinerie
6475cdff7a
Revert "Suppression de la clef "migrated": true sur les filtres des ProcedurePresentation" 2021-07-23 09:26:13 +02:00
Pierre de La Morinerie
fd74d9a062 lib: remove the 'migrated' key on filters
In a9a4f6e2a8, a task to migrate
ProcedurePresentation's filters was added.

This task added a "migrated: true" key to all migrated filters.

Now that this task has run, we can safely remove the extra key.
2021-07-20 16:51:32 +02:00
Pierre de La Morinerie
38c4da2deb lib: document ProgressReport usage 2021-07-20 16:51:32 +02:00
Pierre de La Morinerie
fda59c9231 lib: remove outdated tasks 2021-07-20 15:34:31 +02:00