Skip to content

file: recover legacy checksums and validate shadow header fallback #118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
edsiper merged 7 commits into from
Oct 31, 2026
Merged

file: recover legacy checksums and validate shadow header fallback #118

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
8646cf8
file: recover unfinalized checksums
edsiper May 29, 2026
1902cf6
file: add shadow checksum recovery
edsiper May 30, 2026
ae12038
file: persist zero-length write_at truncation
edsiper May 30, 2026
39479ec
tests: cover read-only shadow checksum recovery
edsiper May 30, 2026
63434e6
tests: cover fluent bit storage lifecycle
edsiper May 30, 2026
200f34d
file: recover legacy wide checksums
edsiper May 30, 2026
a614c86
file: validate shadow recovery precedence and bounds
edsiper Oct 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 7 additions & 2 deletions include/chunkio/cio_file_st.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,9 +37,10 @@
* | 0xC1 | 0x00 +--> Header 2 bytes
* +--------------+----------------+
* | 4 BYTES +--> CRC32(Content)
* | 4 BYTES +--> CRC32(Padding)
* | 4 BYTES +--> Legacy CRC padding
* | 4 BYTES +--> Content length
* | 8 BYTES +--> Padding
* | 4 BYTES +--> Shadow content length
* | 4 BYTES +--> Shadow CRC32(Content)
* +-------------------------------+
* | Content |
* | +-------------------------+ |
Expand All @@ -62,10 +63,14 @@
#define CIO_FILE_ID_01 0x00 /* header: second byte */
#define CIO_FILE_HEADER_MIN 24 /* 24 bytes for the header */
#define CIO_FILE_CONTENT_OFFSET 22
#define CIO_FILE_LEGACY_CRC_PADDING_OFFSET 6
#define CIO_FILE_LEGACY_CRC_PADDING_SIZE 4
#define CIO_FILE_CONTENT_LENGTH_OFFSET 10 /* We store the content length
* right after the checksum in
* what used to be padding
*/
#define CIO_FILE_SHADOW_CONTENT_LENGTH_OFFSET 14
#define CIO_FILE_SHADOW_HASH_OFFSET 18
/* Return pointer to hash position */
static inline char *cio_file_st_get_hash(char *map)
{
Expand Down
Loading
Loading