It is very normal for the first harvest (and maybe even the second) to include a lot of unprocessed material. The initial bedding layer was likely 6 to 8 inches deep so it's likely that the worms were not able to process all of it before heading higher into fresher layers of waste.
Go ahead and take that material and put it back into the top of your Urban Worm Bag for another trip through.