C# ASP.NET MVC: develop app with running tasks and ASP.NET MVC web UI to control it

Question

There's a url from which I need to run api get data in JSON format and store to MS-Sql Server. This project will run mostly on server(s).

We also need an application to provide an interface so that whenever needed user can select which data to be stored from the json from it.

The data will be stored in the database according to these settings and the project should self run in background periodically like monthly/weekly/daily and send the data from api to database.

This would be an in house development for my company only and may run on few number of servers within the company.

I have an idea of developing a ASP.Net web app for UI part which can save the settings in xml/json file. There would be a separate web service which will run periodically and fetch and store the data from api to sql server according to the settings.

I can't use Azure in my project.

Chatgpt/Gemini is advising me to use 3rd party tools like hangfire for background tasks. However I think using 3rd party tools creates an additional dependency.

What is the tech stack of application/architecture/platform in dot net core is best suitable for this requirement?

Answer 1

As far as I can tell the only issue you are facing is how to run scheduled tasks. SQL Server has SQL Agent which can be scheduled to execute T-SQL or SSIS.

https://learn.microsoft.com/en-us/sql/ssms/agent/sql-server-agent?view=sql-server-ver16

https://learn.microsoft.com/en-us/sql/integration-services/control-flow/web-service-task?view=sql-server-ver16

Windows has a Task Scheduler that can execute built code.

https://learn.microsoft.com/en-us/troubleshoot/windows-server/system-management-components/schedule-server-process

ASP.NET Core has background tasks which can host a service that executes logic at some frequency X that you get to design.

https://learn.microsoft.com/en-us/aspnet/core/fundamentals/host/hosted-services?view=aspnetcore-8.0&tabs=visual-studio