Have you tried ML.NET?
It's a new machine learning framework made specifically for .NET developers.

.NET Community Standup