Commit graph

327 commits

Author SHA1 Message Date
Rebeka Dekany
7493936bad Merge pull request #22310 from overleaf/ar-bump-mongoose-8.8.3
[web] Upgrade mongoose to 8.8.3

GitOrigin-RevId: 5540f7384b74daafa01522c23633587fc56a7faa
2024-12-06 09:05:25 +00:00
Brian Gough
104ae341b1 Merge pull request #22327 from overleaf/bg-fix-copy-blob
fix bug that prevents copying blobs between different backends in history-v1

GitOrigin-RevId: 41140ad42d0d7c1beda83e588649127c22603dec
2024-12-05 09:05:22 +00:00
Andrew Rumble
d1735f549c Merge pull request #22278 from overleaf/ar-improve-history-v1-get-project-blobs-errors
[history-v1] improve getProjectBlob errors

GitOrigin-RevId: 2148f002edc3f63e0236eb139df34a22d7eb33d5
2024-12-04 09:04:42 +00:00
Jakob Ackermann
d19c5e236f Merge pull request #22208 from overleaf/jpa-clsi-hash
[misc] clsi: read files from history-v1 with fallback to filestore

GitOrigin-RevId: c54bb128780198c14e7a63818f39fad62ce65d4e
2024-11-29 09:05:39 +00:00
Jakob Ackermann
ce0d5fd383 Merge pull request #22177 from overleaf/jpa-file-view-hash-1
[web] migrate file-view to download from history-v1 (via web) 1/2

GitOrigin-RevId: b787e90c57af5e2704b06ba63502aa6fc09ea1df
2024-11-28 09:06:33 +00:00
Brian Gough
be90a3b2bb Merge pull request #22170 from overleaf/bg-history-v1-copy-blob
add copyBlob support to history-v1

GitOrigin-RevId: 797ea66c37ca938fc906c4dff7bb1c8bf14c031e
2024-11-28 09:05:30 +00:00
Jakob Ackermann
9357f51fcf Merge pull request #22092 from overleaf/jpa-jq
[history-v1] install jq in the docker image

GitOrigin-RevId: c47516b02d52b4def6cd0c793868175b5d4b16e4
2024-11-28 09:05:02 +00:00
Jakob Ackermann
3d7254b419 Merge pull request #22153 from overleaf/jpa-backup-verifier-minimal
[history-v1] backup-verifier-app: initial revision

GitOrigin-RevId: 922c9f94cb7ca7c129e38fd6961d42bdff819cd8
2024-11-27 09:04:55 +00:00
Jakob Ackermann
3d0f5188ae Merge pull request #22143 from overleaf/jpa-extra-test
[history-v1] back_fill_file_hash: add extra test

GitOrigin-RevId: dddc6fdf4a6a7608a8a096537ebf47fe360709a8
2024-11-27 09:04:34 +00:00
Jakob Ackermann
40603e0561 Merge pull request #22134 from overleaf/jpa-broken-file-trees
[history-v1] back_fill_file_hash: gracefully handle broken file-trees

GitOrigin-RevId: 463c785e98581364b107f3262951e7fa0fb88a0f
2024-11-26 09:05:51 +00:00
Jakob Ackermann
b7d37b434a Merge pull request #22123 from overleaf/jpa-process-hashed
[history-v1] back_fill_file_hash: optionally process hashed files

GitOrigin-RevId: 53ebaa7b03166a6b1aacc0f985bb295c9ec04804
2024-11-26 09:05:47 +00:00
Jakob Ackermann
0bd8729cc1 Merge pull request #22115 from overleaf/jpa-skip-get
[history-v1] back_fill_file_hash: optimize obtaining the DEK

GitOrigin-RevId: 6fc5218737551ae4e6152414c32560f545767091
2024-11-26 09:04:50 +00:00
Jakob Ackermann
ed27af11f8 Merge pull request #22107 from overleaf/jpa-error-handling
[history-v1] back_fill_file_hash: error handling

GitOrigin-RevId: 2dbf52d015206cf42ca434b1f16221d6e0f2cc2b
2024-11-26 09:04:45 +00:00
Jakob Ackermann
1a6bd670d4 Merge pull request #22104 from overleaf/jpa-graceful-shutdown-abort-retries
[history-v1] back_fill_file_hash: abort retries during graceful shutdown

GitOrigin-RevId: 0d52dde32e4a7bf2293f341644b7416e669b2bdc
2024-11-25 09:05:31 +00:00
Jakob Ackermann
651fad7401 Merge pull request #22099 from overleaf/jpa-timeout
[history-v1] back_fill_file_hash: increase S3 httpOptions.timeout

GitOrigin-RevId: cd01f78597c517c9530f14a5ccc6defe2b49446b
2024-11-25 09:05:26 +00:00
Jakob Ackermann
838ae23b52 Merge pull request #22091 from overleaf/jpa-bad-file-trees
[history-v1] back_fill_file_hash: gracefully handle bad file-trees

GitOrigin-RevId: 0419c06b1ccf827f4c6c5170978a38659435f26f
2024-11-25 09:05:02 +00:00
Jakob Ackermann
c2b876372b Merge pull request #22070 from overleaf/jpa-args
[history-v1] refactor env vars to args for GNU-parallel usage

GitOrigin-RevId: 1ebfa3dfc25d36f2f86c22fa22e4864d55b511b2
2024-11-22 09:06:11 +00:00
Andrew Rumble
77831b60bf Merge pull request #22059 from overleaf/ar-update-node-18-in-recent-history-changes
[history-v1] Update more missed node 18 usages

GitOrigin-RevId: 481e3de95dc34ef2bca38302a3ff595a92cea6ed
2024-11-22 09:06:00 +00:00
Jakob Ackermann
69021ca4b0 Merge pull request #22061 from overleaf/jpa-reduce-idle-time
[history-v1] back_fill_file_hash: reduce idle time between batches

GitOrigin-RevId: 9b24bb882b158f33915d2e0ab2f82273eac09739
2024-11-22 09:05:55 +00:00
Jakob Ackermann
4f25b0de91 Merge pull request #22028 from overleaf/jpa-logging
[misc] logging tweaks

GitOrigin-RevId: 7757b81b6c684955374038376035dc2bd272c4e8
2024-11-21 09:05:41 +00:00
Jakob Ackermann
44e0428496 Merge pull request #22019 from overleaf/jpa-cleanup
[history-v1] back_fill_file_hash: cleanup BUFFER_DIR when done

GitOrigin-RevId: 6413292bbe8cca470919b740d7e2b45fc5e7d824
2024-11-21 09:05:05 +00:00
Jakob Ackermann
2e630e50dc Merge pull request #22017 from overleaf/jpa-process-all-projects
[history-v1] back_fill_file_hash: process all projects

GitOrigin-RevId: 41c3cd59022bbac09552684ef2a99c58f2235ac3
2024-11-21 09:04:50 +00:00
Jakob Ackermann
1fca37af61 Merge pull request #22016 from overleaf/jpa-fix-flaky-test
[history-v1] back_fill_file_hash: fix typo in tests and add comments

GitOrigin-RevId: a4055d7dd33ba584a2a86053470585f412392305
2024-11-21 09:04:46 +00:00
Jakob Ackermann
6de1817ef5 Merge pull request #22013 from overleaf/jpa-flush-mongo-queues-early
[history-v1] back_fill_file_hash: flush mongo write queues early

GitOrigin-RevId: 9b6c6ff9861945e69e42d15dc19f4c03c39193e9
2024-11-21 09:04:42 +00:00
Jakob Ackermann
73aea01f37 Merge pull request #21996 from overleaf/jpa-stream-pg-result
[history-v1] postgres: getProjectBlobsBatch: stream records

GitOrigin-RevId: 94ed6dfc4a263fd9369cd380e6cc25c7bbf6decc
2024-11-21 09:04:38 +00:00
Jakob Ackermann
67ca6a74b2 Merge pull request #22004 from overleaf/jpa-default-s3-timeout
[history-v1] increase default HTTP timeout for backupPersistor

GitOrigin-RevId: 4bcf849488211f074a2200646b048e963070ee52
2024-11-21 09:04:11 +00:00
Andrew Rumble
adecf0d5fe Merge pull request #21998 from overleaf/ar-fix-flaky-project-archive-test
[history-v1] Handle race condition in project archive test

GitOrigin-RevId: c32f4646f08223da0ed42068fa3fb613a6595b95
2024-11-21 09:03:35 +00:00
Jakob Ackermann
0253130c36 Merge pull request #21972 from overleaf/jpa-get-project-blobs-batch
[history-v1] implement getProjectBlobsBatch

GitOrigin-RevId: f03dcc690ef63f72400ccf001c6e497bd4fbe790
2024-11-20 09:05:34 +00:00
Jakob Ackermann
4964d6414b Merge pull request #21982 from overleaf/jpa-cleanup
[history-v1] back_fill_file_hash: cleanup fs and graceful shutdown

GitOrigin-RevId: 362669ff988ad71fda713bf4896b1abcb36caf35
2024-11-20 09:05:30 +00:00
Jakob Ackermann
24f2388aa2 Merge pull request #21948 from overleaf/bg-jpa-back-fill-project-blobs
[history-v1] back_fill_file_hash: process blobs

GitOrigin-RevId: e54d0f8ab537ce43a12f9c972ba2ee82836073c8
2024-11-20 09:05:04 +00:00
Jakob Ackermann
fb36fff63d Merge pull request #21931 from overleaf/bg-get-all-blobs-for-project
add getProjectBlobs method to retrieve metadata for all blobs in a project

GitOrigin-RevId: 38f504a4fb56cd8ef8beaff1d8917ead26e85f5a
2024-11-20 09:04:56 +00:00
Jakob Ackermann
8e74d3c58c Merge pull request #21947 from overleaf/bg-jpa-back-fill-script-tweaks
[history-v1] back_fill_file_hash: performance tweaks

GitOrigin-RevId: c3d0c7906707fc902addcde64eaf41c24ceeece7
2024-11-20 09:04:51 +00:00
Jakob Ackermann
27076c50cc Merge pull request #21670 from overleaf/jpa-mongo-backend-types
[history-v1] add types to mongo BlobStore backend

GitOrigin-RevId: 7d91074eaa781904f7f3b56390aacee1800a7f67
2024-11-19 09:05:23 +00:00
Jakob Ackermann
ca0a46b5bb Merge pull request #21928 from overleaf/jpa-handle-already-hard-deleted
[history-v1] backup-deletion-app: use deletedProjectOverleafHistoryId

GitOrigin-RevId: 169ba0fba71c42b0415e5fa40424547b054dd5b0
2024-11-18 09:06:13 +00:00
Jakob Ackermann
dd15ade2b9 Merge pull request #21880 from overleaf/jpa-history-store
[history-v1] make HistoryStore generic and add backupHistoryStore

GitOrigin-RevId: 65d275de182dbcf5d4b6bf3c610b71b58db68e70
2024-11-18 09:05:48 +00:00
Jakob Ackermann
9cc6f2a9d5 Merge pull request #21829 from overleaf/jpa-backup-deletion
[history-v1] backup-deletion-app: initial revision

GitOrigin-RevId: 9e05c0e16595cb8d180861ef503c7b4522110d39
2024-11-18 09:05:44 +00:00
Jakob Ackermann
97b39ef98f Merge pull request #21681 from overleaf/jpa-back-fill-file-hash
[history-v1] add script for back filling hash into project file-tree

GitOrigin-RevId: 70ab8c72f3eea1062708e4471b4ad1c60317ad26
2024-11-18 09:05:39 +00:00
Andrew Rumble
73b17dd694 Merge pull request #21627 from overleaf/ar-node-20
[all] node 20 upgrade v2

GitOrigin-RevId: aed13a800894717a796062e3dd4050e045040258
2024-11-15 09:04:32 +00:00
Jakob Ackermann
805c4f8321 Merge pull request #21764 from overleaf/jpa-esm-build-scripts
[misc] prepare linting for ESM files in services

GitOrigin-RevId: 468983ebff40617158bac28514381a6aaf725893
2024-11-12 09:05:50 +00:00
Jakob Ackermann
61c7c728ad Merge pull request #21755 from overleaf/jpa-history-initialize-project
[history-v1] tests: use createEmptyProject helper consistently

GitOrigin-RevId: 80d979091d80c53c780919700561849d9703368e
2024-11-12 09:05:46 +00:00
Antoine Clausse
7f48c67512 Add prefer-node-protocol ESLint rule (#21532)
* Add `unicorn/prefer-node-protocol`

* Fix `unicorn/prefer-node-protocol` ESLint errors

* Run `npm run format:fix`

* Add sandboxed-module sourceTransformers in mocha setups

Fix `no such file or directory, open 'node:fs'` in `sandboxed-module`

* Remove `node:` in the SandboxedModule requires

* Fix new linting errors with `node:`

GitOrigin-RevId: 68f6e31e2191fcff4cb8058dd0a6914c14f59926
2024-11-11 09:04:51 +00:00
Jakob Ackermann
a3d8caf87b Merge pull request #21664 from overleaf/jpa-blob-hash
[overleaf-editor-core] stricter types for Blob interface

GitOrigin-RevId: 8595fce0d5c98074d2313be5a5634e80f92c68b5
2024-11-08 09:07:05 +00:00
Andrew Rumble
57d12dfb17 Update to node 18.20.4
GitOrigin-RevId: 4b613ea3973cb7944c3d414ea91bcf367dbf50a6
2024-11-07 09:04:31 +00:00
Jakob Ackermann
5bb90dc6cb Merge pull request #21442 from overleaf/jpa-align-mongo-version
[misc] align all the mongodb dependency versions

GitOrigin-RevId: 1194fe57601af98bb61250a285bfc85b4b8179dd
2024-11-01 09:05:23 +00:00
Andrew Rumble
79d80cc266 Merge pull request #21462 from overleaf/revert-18828-ac-node-20
Revert "Upgrade Node from `18.20.2` to `20.17.0`"

GitOrigin-RevId: cc12c33b4588caa2959817a113547d20d437d6f4
2024-10-30 09:05:07 +00:00
Andrew Rumble
a480df8a89 Merge pull request #18828 from overleaf/ac-node-20
Upgrade Node from `18.20.2` to `20.17.0`

GitOrigin-RevId: 0ba9b0921fc246a97d3da0aad7d48635c0e24ae8
2024-10-30 09:04:38 +00:00
Antoine Clausse
6c2cf20125 Merge pull request #20552 from overleaf/ac-update-node-fetch-2
Reapply "Upgrade node-fetch to 2.7.0", Fix fetch-utils tests

GitOrigin-RevId: b42a2d2c50ce73f474e39755845e4df065f30b48
2024-10-01 08:05:18 +00:00
Brian Gough
37806a9505 Merge pull request #20695 from overleaf/bg-issue15972
Await knex.transaction for deleteProjectChunks in history-v1

GitOrigin-RevId: fcf342c5d1e0e9beed35c75d0317f8cba5976e24
2024-10-01 08:04:52 +00:00
Liangjun Song
cfd0b39b96 Merge pull request #20557 from overleaf/ls-bump-express
update express and other dependencies

GitOrigin-RevId: 22107eab0fa95d534ab07360548ae2b2123776db
2024-09-27 08:04:18 +00:00
Jakob Ackermann
e3feafb7b0 Merge pull request #20332 from overleaf/jpa-small-runner
[misc] CI improvements

GitOrigin-RevId: 819d4d357fcb130f133337668644eedcf5f4a688
2024-09-26 08:04:38 +00:00