# I need help with debugging duplicates when reading SQLite leaf interior pages **URL:** \ **Category:** Challenges\ **Tags:** challenge:sqlite\ **Created:** [October 20, 2024, 11:53am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481 "2024-10-20T11:53:45Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![rodio](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/rodio/32/1398_2.png) [@rodio](https://forum.codecrafters.io/u/rodio)\ **Post date:** [October 20, 2024, 11:53am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/1 "2024-10-20T11:53:45Z")
I’m stuck on Stage #WS9. It looks like I’m reading the same inforamtion from different leaf pages twice. My understanding is that the root page of the `superheroes` table is an interior table page. So I read its children and I add them to the results of the query (if a child is a leaf page) or call my `read_interior_page()` recursively (if a child is an interior page). I’ve tried to print the results that I’m getting from every leaf cell from a child of the root page and one layer below: ```rust for cell in &interior_page.cells { let pointer = (cell.left_child_page_num * u32::from(self.header.page_size)).into(); let child = Self::get_page(self, pointer, None)?; match child { Page::LeafTable(leaf) => { let mut r = Self::read_leaf_page(&leaf, query, table_info)?; if !r.is_empty() { println!("got from leaf table {}: {:?}", &leaf.offset / 4096, r); } res.append(&mut r); } Page::InteriorTable(interior) => { for cell in &interior.cells { let pointer = (cell.left_child_page_num * u32::from(self.header.page_size)).into(); let child = Self::get_page(self, pointer, None)?; match child { Page::LeafTable(leaf) => { let mut r = Self::read_leaf_page(&leaf, query, table_info)?; if !r.is_empty() { println!( "got from INNER leaf table {}: {:?}", &leaf.offset / 4096, r ); } res.append(&mut r); } Page::InteriorTable(_) => todo!("next layer"), Page::LeafIndex => (), Page::InteriorIndex => (), } } } _ => { //dbg!("other type"); } } } ``` Here are my logs: ```auto got from leaf table 49: [["350", "Congorilla (New Earth)"]] got from leaf table 36: [["1131", "Lambien (New Earth)"]] got from INNER leaf table 75: [["350", "Congorilla (New Earth)"]] got from INNER leaf table 94: [["1131", "Lambien (New Earth)"]] got from INNER leaf table 151: [["4533", "Kal-El (DC One Million)"]] got from INNER leaf table 123: [["5496", "Midas (New Earth)"]] got from leaf table 271: [["4533", "Kal-El (DC One Million)"]] got from leaf table 267: [["4765", "Ahura-Mazda (New Earth)"]] got from leaf table 254: [["5496", "Midas (New Earth)"]] ``` So it looks like the numbers of the pages are different, but the data stored inside is the same. This does not seem correct to me, so I would appreciate any tips on how to fix it. Thank you very much! ---
**Author:** ![andy1li](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/andy1li/32/10_2.png) [@andy1li](https://forum.codecrafters.io/u/andy1li)\ **Post date:** [October 21, 2024, 5:20am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/3 "2024-10-21T05:20:24Z")
@rodio Looks like you’ve successfully passed #WS9. 🎉 Just checking – do you still need any assistance with this? If not, would you mind sharing how you got unstuck? ---
**Author:** ![rodio](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/rodio/32/1398_2.png) [@rodio](https://forum.codecrafters.io/u/rodio)\ **Post date:** [October 21, 2024, 8:27am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/5 "2024-10-21T08:27:59Z")
@andy1li thanks for your reply! It did pass, but only because I’ve added deduplication at the end. This way I know that all rows are present, but some of them are duplicated. Still don’t know why data is duplicated in the first place. I’d appreciate if you could help! ---
**Author:** ![andy1li](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/andy1li/32/10_2.png) [@andy1li](https://forum.codecrafters.io/u/andy1li)\ **Post date:** [October 21, 2024, 9:37am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/7 "2024-10-21T09:37:09Z")
@rodio Got it. I’ll take a look as soon as possible. **EDIT** : Sorry, I’m a bit tied up this week. I’ll get back to you early next week. ---
**Author:** ![rodio](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/rodio/32/1398_2.png) [@rodio](https://forum.codecrafters.io/u/rodio)\ **Post date:** [October 21, 2024, 3:42pm UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/8 "2024-10-21T15:42:10Z")
I’ve noticed that `codecrafters test` runs different set of tests, is that correct? Anyway, the version of the code that I have now works on a set of tests that does not include `./your_program.sh test.db "SELECT id, name FROM superheroes WHERE hair_color = 'Reddish Brown Hair'"` and ` $ ./your_program.sh test.db "SELECT id, name FROM superheroes WHERE eye_color = 'Amber Eyes'"` ---
**Author:** ![andy1li](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/andy1li/32/10_2.png) [@andy1li](https://forum.codecrafters.io/u/andy1li)\ **Post date:** [October 28, 2024, 9:18am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/9 "2024-10-28T09:18:34Z")
@rodio Yep, our tests use randomized queries to prevent hardcoded responses. In the latest version of you code, I noticed some commented-out code for nested `InteriorTable`, so I added a `panic!` to check if it’s reachable—and it turns out it is. ![image](https://canada1.discourse-cdn.com/flex003/uploads/codecrafters/original/2X/9/93dd19d7fb023200ec0c83d0871aa5e613cbca46.png) ![image](https://canada1.discourse-cdn.com/flex003/uploads/codecrafters/original/2X/b/bdc661785322a44379f4ceb209beb1d4564bf370.png) Fleshing out that commented-out arm should bring you closer to passing this stage. Let me know if you’d like to discuss how to approach the implementation! ---
**Author:** ![rodio](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/rodio/32/1398_2.png) [@rodio](https://forum.codecrafters.io/u/rodio)\ **Post date:** [October 28, 2024, 9:46am UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/11 "2024-10-28T09:46:18Z")
Thanks for your help! Yes, I’d like to discuss it further if possible. I tried to read the nested interior tables through calling that “read\_interior\_page” recursively. This is when I see duplicates. As you can see in the logs in my first message, it looks like the root page has both child leaf pages and also child interior pages (log messages “got from INNER leaf table”). On the other hand, the documentation states that “In a well-formed database, all children of an interior b-tree have the same depth” so I think this should not be possible. Is calling `read_interior_page` recursively a wrong approach? ---
**Author:** ![andy1li](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/andy1li/32/10_2.png) [@andy1li](https://forum.codecrafters.io/u/andy1li)\ **Post date:** [October 29, 2024, 5:32pm UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/13 "2024-10-29T17:32:53Z")
@rodio I believe calling read\_interior\_page recursively is the right approach. I’ve confirmed that superheroes.db contains duplicate pages, but I’ll need to check with the team to determine whether this is intentional or something that needs fixing. I’ll keep you posted with any updates. ---
**Author:** ![andy1li](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/andy1li/32/10_2.png) [@andy1li](https://forum.codecrafters.io/u/andy1li)\ **Post date:** [October 29, 2024, 10:47pm UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/14 "2024-10-29T22:47:49Z")
Final findings: 1. Ran `sqlite3_analyzer superheroes.db` > Table SUPERHEROES > > Number of entries… 6895 > **B-tree depth… 2** > Primary pages used… 109 A B-tree of depth 2 indicates that there are no nested interior table pages—just a root page with 108 leaf pages below it. 1. @rodio Turns out there’s an off-by-one error in your code here: ```rust fn read_interior_page(...) ->... { let pointer = (cell.left_child_page_num * ...).into(); ``` Fixing this error should help your code pass stage #WS9. 1. The previously encountered “ ~~nested~~ interior table pages” were likely [free pages](https://www.sqlite.org/fileformat.html#free_page_list) with residual duplicate data. ---
**Author:** ![rodio](https://yyz1.discourse-cdn.com/flex003/user_avatar/forum.codecrafters.io/rodio/32/1398_2.png) [@rodio](https://forum.codecrafters.io/u/rodio)\ **Post date:** [October 30, 2024, 2:06pm UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/16 "2024-10-30T14:06:55Z")
@andy1li Thank you for the detailed explanation! It was indeed that off-by-one error. ---
**Author:** ![system](https://canada1.discourse-cdn.com/flex003/uploads/codecrafters/original/3X/7/0/700657133935c15703e22c7c8870394f6e6dc27d.svg) [@system](https://forum.codecrafters.io/u/system)\ **Post date:** [November 4, 2024, 2:07pm UTC](https://forum.codecrafters.io/t/i-need-help-with-debugging-duplicates-when-reading-sqlite-leaf-interior-pages/2481/17 "2024-11-04T14:07:17Z")
This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.