[Kernel] Implement Pagination Support in Kernel

[mmmyr]

Overview

This issue tracks the implementation of pagination support.
[Prototype]: #4786

Project Tracking

Merged = ✅
Needs Review = 👀
Work in progress = ⏳
Abandoned = 🛑

Refactor

Description	PR	Status	Created	Merged
Refactor Parquet Reader API	#4802	✅	2025-06-24	2025-06-27
Refactor Action Wrapper	#4852	✅	2025-06-30	2025-06-30
Refactor JSON Reader API

Milestone 0.1: Users can build and use Pagination Scan

Description	PR	Status	Created	Merged
Pagination API	#4836	✅	2025-06-24	2025-06-27
Page Token Class	#4848	✅	2025-06-27
Pagination Context Class	#4860	👀	2025-06-30
Pagination Filtered Columnar Batch	#4853	👀	2025-06-30
Read First Page (no sidecar)	#4837	⏳
Read First Page (with sidecar)
Support JSON Files & regular CP files	#4844	⏳
Support Multi part CP Files	#4845	⏳
Support Sidecar Files	#4846	⏳
Hash Function for log segment
Hash Function for predicate
Data Integrity Check before pagination
Add Logs

Milestone 0.2: Cached Tombstone Sets for better performance

Milestone 0.3: Support underlying log segment changes