Jakob Ackermann
70fd6cacbc
Merge pull request #22711 from overleaf/jpa-gzip
...
[history-v1] compress blobs before sending them to AWS
GitOrigin-RevId: 1ca1dda6f36738fbabbf00fdab62b86230b9e4f9
2025-01-08 09:04:57 +00:00
Jakob Ackermann
8171ffafc5
Merge pull request #22710 from overleaf/jpa-fix-tests
...
[history-v1] fix tests
GitOrigin-RevId: dd16d078a4bfea108e9035c0a83f4fd5c3dd715b
2025-01-08 09:04:52 +00:00
Andrew Rumble
2262d03a21
Merge pull request #22648 from overleaf/ar-store-backup-blobs-by-history-id
...
Use historyId when constructing path for backup
GitOrigin-RevId: 954576b509d5e78511b5008fb7d74e0bc5fa45fd
2024-12-24 09:04:52 +00:00
Andrew Rumble
31e8a908ee
Merge pull request #22334 from overleaf/ar-guard-against-integer-like-strings-when-working-with-postgres
...
[history-v1] Guard against non-postgres projectIds
GitOrigin-RevId: 5bf75c67424297f52f2abd9d0f0f14a0f79f8921
2024-12-13 09:04:59 +00:00
Andrew Rumble
a92a37bc3c
Merge pull request #22466 from overleaf/ar-backup-files-when-inserting
...
[history-v1] backup files when inserting
GitOrigin-RevId: e636bce178604978c6d41c083bf671795d20b5a1
2024-12-13 09:04:54 +00:00
Andrew Rumble
52254b5695
Merge pull request #22459 from overleaf/revert-22392-ar-backup-files-when-inserting
...
Revert "[history-v1] backup files when inserting"
GitOrigin-RevId: f21d49dbc8909ab93bdde78c321672124bb13697
2024-12-12 09:05:27 +00:00
Andrew Rumble
6404e3047d
Merge pull request #22392 from overleaf/ar-backup-files-when-inserting
...
[history-v1] backup files when inserting
GitOrigin-RevId: 1649b2828899d67ee37c0ac331917c6d5424c803
2024-12-12 09:05:11 +00:00
Rebeka Dekany
7493936bad
Merge pull request #22310 from overleaf/ar-bump-mongoose-8.8.3
...
[web] Upgrade mongoose to 8.8.3
GitOrigin-RevId: 5540f7384b74daafa01522c23633587fc56a7faa
2024-12-06 09:05:25 +00:00
Brian Gough
104ae341b1
Merge pull request #22327 from overleaf/bg-fix-copy-blob
...
fix bug that prevents copying blobs between different backends in history-v1
GitOrigin-RevId: 41140ad42d0d7c1beda83e588649127c22603dec
2024-12-05 09:05:22 +00:00
Andrew Rumble
d1735f549c
Merge pull request #22278 from overleaf/ar-improve-history-v1-get-project-blobs-errors
...
[history-v1] improve getProjectBlob errors
GitOrigin-RevId: 2148f002edc3f63e0236eb139df34a22d7eb33d5
2024-12-04 09:04:42 +00:00
Jakob Ackermann
d19c5e236f
Merge pull request #22208 from overleaf/jpa-clsi-hash
...
[misc] clsi: read files from history-v1 with fallback to filestore
GitOrigin-RevId: c54bb128780198c14e7a63818f39fad62ce65d4e
2024-11-29 09:05:39 +00:00
Jakob Ackermann
ce0d5fd383
Merge pull request #22177 from overleaf/jpa-file-view-hash-1
...
[web] migrate file-view to download from history-v1 (via web) 1/2
GitOrigin-RevId: b787e90c57af5e2704b06ba63502aa6fc09ea1df
2024-11-28 09:06:33 +00:00
Brian Gough
be90a3b2bb
Merge pull request #22170 from overleaf/bg-history-v1-copy-blob
...
add copyBlob support to history-v1
GitOrigin-RevId: 797ea66c37ca938fc906c4dff7bb1c8bf14c031e
2024-11-28 09:05:30 +00:00
Jakob Ackermann
9357f51fcf
Merge pull request #22092 from overleaf/jpa-jq
...
[history-v1] install jq in the docker image
GitOrigin-RevId: c47516b02d52b4def6cd0c793868175b5d4b16e4
2024-11-28 09:05:02 +00:00
Jakob Ackermann
3d7254b419
Merge pull request #22153 from overleaf/jpa-backup-verifier-minimal
...
[history-v1] backup-verifier-app: initial revision
GitOrigin-RevId: 922c9f94cb7ca7c129e38fd6961d42bdff819cd8
2024-11-27 09:04:55 +00:00
Jakob Ackermann
3d0f5188ae
Merge pull request #22143 from overleaf/jpa-extra-test
...
[history-v1] back_fill_file_hash: add extra test
GitOrigin-RevId: dddc6fdf4a6a7608a8a096537ebf47fe360709a8
2024-11-27 09:04:34 +00:00
Jakob Ackermann
40603e0561
Merge pull request #22134 from overleaf/jpa-broken-file-trees
...
[history-v1] back_fill_file_hash: gracefully handle broken file-trees
GitOrigin-RevId: 463c785e98581364b107f3262951e7fa0fb88a0f
2024-11-26 09:05:51 +00:00
Jakob Ackermann
b7d37b434a
Merge pull request #22123 from overleaf/jpa-process-hashed
...
[history-v1] back_fill_file_hash: optionally process hashed files
GitOrigin-RevId: 53ebaa7b03166a6b1aacc0f985bb295c9ec04804
2024-11-26 09:05:47 +00:00
Jakob Ackermann
0bd8729cc1
Merge pull request #22115 from overleaf/jpa-skip-get
...
[history-v1] back_fill_file_hash: optimize obtaining the DEK
GitOrigin-RevId: 6fc5218737551ae4e6152414c32560f545767091
2024-11-26 09:04:50 +00:00
Jakob Ackermann
ed27af11f8
Merge pull request #22107 from overleaf/jpa-error-handling
...
[history-v1] back_fill_file_hash: error handling
GitOrigin-RevId: 2dbf52d015206cf42ca434b1f16221d6e0f2cc2b
2024-11-26 09:04:45 +00:00
Jakob Ackermann
1a6bd670d4
Merge pull request #22104 from overleaf/jpa-graceful-shutdown-abort-retries
...
[history-v1] back_fill_file_hash: abort retries during graceful shutdown
GitOrigin-RevId: 0d52dde32e4a7bf2293f341644b7416e669b2bdc
2024-11-25 09:05:31 +00:00
Jakob Ackermann
651fad7401
Merge pull request #22099 from overleaf/jpa-timeout
...
[history-v1] back_fill_file_hash: increase S3 httpOptions.timeout
GitOrigin-RevId: cd01f78597c517c9530f14a5ccc6defe2b49446b
2024-11-25 09:05:26 +00:00
Jakob Ackermann
838ae23b52
Merge pull request #22091 from overleaf/jpa-bad-file-trees
...
[history-v1] back_fill_file_hash: gracefully handle bad file-trees
GitOrigin-RevId: 0419c06b1ccf827f4c6c5170978a38659435f26f
2024-11-25 09:05:02 +00:00
Jakob Ackermann
c2b876372b
Merge pull request #22070 from overleaf/jpa-args
...
[history-v1] refactor env vars to args for GNU-parallel usage
GitOrigin-RevId: 1ebfa3dfc25d36f2f86c22fa22e4864d55b511b2
2024-11-22 09:06:11 +00:00
Andrew Rumble
77831b60bf
Merge pull request #22059 from overleaf/ar-update-node-18-in-recent-history-changes
...
[history-v1] Update more missed node 18 usages
GitOrigin-RevId: 481e3de95dc34ef2bca38302a3ff595a92cea6ed
2024-11-22 09:06:00 +00:00
Jakob Ackermann
69021ca4b0
Merge pull request #22061 from overleaf/jpa-reduce-idle-time
...
[history-v1] back_fill_file_hash: reduce idle time between batches
GitOrigin-RevId: 9b24bb882b158f33915d2e0ab2f82273eac09739
2024-11-22 09:05:55 +00:00
Jakob Ackermann
4f25b0de91
Merge pull request #22028 from overleaf/jpa-logging
...
[misc] logging tweaks
GitOrigin-RevId: 7757b81b6c684955374038376035dc2bd272c4e8
2024-11-21 09:05:41 +00:00
Jakob Ackermann
44e0428496
Merge pull request #22019 from overleaf/jpa-cleanup
...
[history-v1] back_fill_file_hash: cleanup BUFFER_DIR when done
GitOrigin-RevId: 6413292bbe8cca470919b740d7e2b45fc5e7d824
2024-11-21 09:05:05 +00:00
Jakob Ackermann
2e630e50dc
Merge pull request #22017 from overleaf/jpa-process-all-projects
...
[history-v1] back_fill_file_hash: process all projects
GitOrigin-RevId: 41c3cd59022bbac09552684ef2a99c58f2235ac3
2024-11-21 09:04:50 +00:00
Jakob Ackermann
1fca37af61
Merge pull request #22016 from overleaf/jpa-fix-flaky-test
...
[history-v1] back_fill_file_hash: fix typo in tests and add comments
GitOrigin-RevId: a4055d7dd33ba584a2a86053470585f412392305
2024-11-21 09:04:46 +00:00
Jakob Ackermann
6de1817ef5
Merge pull request #22013 from overleaf/jpa-flush-mongo-queues-early
...
[history-v1] back_fill_file_hash: flush mongo write queues early
GitOrigin-RevId: 9b6c6ff9861945e69e42d15dc19f4c03c39193e9
2024-11-21 09:04:42 +00:00
Jakob Ackermann
73aea01f37
Merge pull request #21996 from overleaf/jpa-stream-pg-result
...
[history-v1] postgres: getProjectBlobsBatch: stream records
GitOrigin-RevId: 94ed6dfc4a263fd9369cd380e6cc25c7bbf6decc
2024-11-21 09:04:38 +00:00
Jakob Ackermann
67ca6a74b2
Merge pull request #22004 from overleaf/jpa-default-s3-timeout
...
[history-v1] increase default HTTP timeout for backupPersistor
GitOrigin-RevId: 4bcf849488211f074a2200646b048e963070ee52
2024-11-21 09:04:11 +00:00
Andrew Rumble
adecf0d5fe
Merge pull request #21998 from overleaf/ar-fix-flaky-project-archive-test
...
[history-v1] Handle race condition in project archive test
GitOrigin-RevId: c32f4646f08223da0ed42068fa3fb613a6595b95
2024-11-21 09:03:35 +00:00
Jakob Ackermann
0253130c36
Merge pull request #21972 from overleaf/jpa-get-project-blobs-batch
...
[history-v1] implement getProjectBlobsBatch
GitOrigin-RevId: f03dcc690ef63f72400ccf001c6e497bd4fbe790
2024-11-20 09:05:34 +00:00
Jakob Ackermann
4964d6414b
Merge pull request #21982 from overleaf/jpa-cleanup
...
[history-v1] back_fill_file_hash: cleanup fs and graceful shutdown
GitOrigin-RevId: 362669ff988ad71fda713bf4896b1abcb36caf35
2024-11-20 09:05:30 +00:00
Jakob Ackermann
24f2388aa2
Merge pull request #21948 from overleaf/bg-jpa-back-fill-project-blobs
...
[history-v1] back_fill_file_hash: process blobs
GitOrigin-RevId: e54d0f8ab537ce43a12f9c972ba2ee82836073c8
2024-11-20 09:05:04 +00:00
Jakob Ackermann
fb36fff63d
Merge pull request #21931 from overleaf/bg-get-all-blobs-for-project
...
add getProjectBlobs method to retrieve metadata for all blobs in a project
GitOrigin-RevId: 38f504a4fb56cd8ef8beaff1d8917ead26e85f5a
2024-11-20 09:04:56 +00:00
Jakob Ackermann
8e74d3c58c
Merge pull request #21947 from overleaf/bg-jpa-back-fill-script-tweaks
...
[history-v1] back_fill_file_hash: performance tweaks
GitOrigin-RevId: c3d0c7906707fc902addcde64eaf41c24ceeece7
2024-11-20 09:04:51 +00:00
Jakob Ackermann
27076c50cc
Merge pull request #21670 from overleaf/jpa-mongo-backend-types
...
[history-v1] add types to mongo BlobStore backend
GitOrigin-RevId: 7d91074eaa781904f7f3b56390aacee1800a7f67
2024-11-19 09:05:23 +00:00
Jakob Ackermann
ca0a46b5bb
Merge pull request #21928 from overleaf/jpa-handle-already-hard-deleted
...
[history-v1] backup-deletion-app: use deletedProjectOverleafHistoryId
GitOrigin-RevId: 169ba0fba71c42b0415e5fa40424547b054dd5b0
2024-11-18 09:06:13 +00:00
Jakob Ackermann
dd15ade2b9
Merge pull request #21880 from overleaf/jpa-history-store
...
[history-v1] make HistoryStore generic and add backupHistoryStore
GitOrigin-RevId: 65d275de182dbcf5d4b6bf3c610b71b58db68e70
2024-11-18 09:05:48 +00:00
Jakob Ackermann
9cc6f2a9d5
Merge pull request #21829 from overleaf/jpa-backup-deletion
...
[history-v1] backup-deletion-app: initial revision
GitOrigin-RevId: 9e05c0e16595cb8d180861ef503c7b4522110d39
2024-11-18 09:05:44 +00:00
Jakob Ackermann
97b39ef98f
Merge pull request #21681 from overleaf/jpa-back-fill-file-hash
...
[history-v1] add script for back filling hash into project file-tree
GitOrigin-RevId: 70ab8c72f3eea1062708e4471b4ad1c60317ad26
2024-11-18 09:05:39 +00:00
Andrew Rumble
73b17dd694
Merge pull request #21627 from overleaf/ar-node-20
...
[all] node 20 upgrade v2
GitOrigin-RevId: aed13a800894717a796062e3dd4050e045040258
2024-11-15 09:04:32 +00:00
Jakob Ackermann
805c4f8321
Merge pull request #21764 from overleaf/jpa-esm-build-scripts
...
[misc] prepare linting for ESM files in services
GitOrigin-RevId: 468983ebff40617158bac28514381a6aaf725893
2024-11-12 09:05:50 +00:00
Jakob Ackermann
61c7c728ad
Merge pull request #21755 from overleaf/jpa-history-initialize-project
...
[history-v1] tests: use createEmptyProject helper consistently
GitOrigin-RevId: 80d979091d80c53c780919700561849d9703368e
2024-11-12 09:05:46 +00:00
Antoine Clausse
7f48c67512
Add prefer-node-protocol ESLint rule ( #21532 )
...
* Add `unicorn/prefer-node-protocol`
* Fix `unicorn/prefer-node-protocol` ESLint errors
* Run `npm run format:fix`
* Add sandboxed-module sourceTransformers in mocha setups
Fix `no such file or directory, open 'node:fs'` in `sandboxed-module`
* Remove `node:` in the SandboxedModule requires
* Fix new linting errors with `node:`
GitOrigin-RevId: 68f6e31e2191fcff4cb8058dd0a6914c14f59926
2024-11-11 09:04:51 +00:00
Jakob Ackermann
a3d8caf87b
Merge pull request #21664 from overleaf/jpa-blob-hash
...
[overleaf-editor-core] stricter types for Blob interface
GitOrigin-RevId: 8595fce0d5c98074d2313be5a5634e80f92c68b5
2024-11-08 09:07:05 +00:00
Andrew Rumble
57d12dfb17
Update to node 18.20.4
...
GitOrigin-RevId: 4b613ea3973cb7944c3d414ea91bcf367dbf50a6
2024-11-07 09:04:31 +00:00
