Text this: From Nonparametric Regression to Statistical Inference for Non-Ergodic Diffusion Processes