Yes, you can absolutely start seeds in worm castings. While seeds may have everything they need for germination, there's plenty of evidence that a coating of biology courtesy of worm castings can help the new seedling thrive.
However, you will want to transplant as soon as feasible.