A Geometric Lens on Higher-Order Information in Graph Machine Learning: Challenges, Insights, and Remedies