I am mostly interested in how something as basic and clear as the Pali canon. becomes something so "hidden, esoteric and convoluted" as the rites and rituals of the greater vehicles.

Now not wanting to argue or get into heated debates about the subject.
The Satipatthana sutta may be a nice starting point.

With Love
Eelco