{"id":5531,"date":"2018-09-30T13:00:25","date_gmt":"2018-09-30T13:00:25","guid":{"rendered":"http:\/\/writeasync.net\/?p=5531"},"modified":"2018-09-29T18:01:33","modified_gmt":"2018-09-29T18:01:33","slug":"find-the-issue-long-requests","status":"publish","type":"post","link":"http:\/\/writeasync.net\/?p=5531","title":{"rendered":"Find the issue: long requests"},"content":{"rendered":"

In the previous post<\/a>, I discussed a few design changes to a sample Web API controller to fix up the parameters. Here is where we ended up:<\/p>\n

\r\npublic sealed class MyCommandController : ApiController\r\n{\r\n    public string Post([FromUri] MyCommandParameters p)\r\n    {\r\n        Process myCommand = Process.Start(\r\n            "MyCommand.exe",\r\n            $"-useTheForce {p.useTheForce} -timeout {p.timeout} -auditMessage {p.auditMessage}");\r\n        myCommand.WaitForExit();\r\n        return $"Completed with exit code {myCommand.ExitCode}";\r\n    }\r\n}\r\n<\/pre>\n
Of course, we’re not done yet. I ask again: can you find the next issue in this ASP.NET Web API code snippet?<\/p>\n
Today I would like to direct your attention to that WaitForExit<\/a> call. This is a blocking call which unnecessarily ties up the request thread. You might think, “No problem, let’s just use an async controller action instead!”<\/p>\n
Unfortunately, you will immediately run into another problem once you go that route: there is no async version of WaitForExit<\/code>. All is not lost, however; you could use the Exited<\/a> event to cobble together an async Process pattern<\/a>. It would be a bit of work but certainly achievable. Still, you would have a more fundamental problem — how long are you actually willing to tie up the HTTP request waiting for the process to exit?<\/p>\n
In the general case, it is hard to predict how long an external action may take to complete. Even if usually takes just a few seconds to execute the command, there will always be outliers (as Mark Russinovich can attest<\/a>). We can also use the clue that the command itself in this example takes in a timeout parameter measured in seconds<\/em>. It is safe to say that the request here would commonly need to wait quite a while, relatively speaking.<\/p>\n
Not to worry, though. This is what HTTP 202<\/a> was made for:<\/p>\n
The 202 response is intentionally noncommittal. Its purpose is to allow a server to accept a request for some other process […] without requiring that the user agent’s connection to the server persist until the process is completed.<\/p><\/blockquote>\n
So what we would want to do here is return an initial 202 response with some basic status tracking information and allow the user to call back later for the result. This same technique is used by the Azure Resource Manager<\/a> for its asynchronous REST API<\/a>.<\/p>\n
For this example, we will use a design where all the work is delegated to a MyCommands<\/code> class. It will start new commands with a Start<\/code> method and track existing commands with a Get<\/code> method. The controller actions will be modified accordingly; the Post<\/code> method will call Start<\/code> and return a tracking ID right away, while the new Get<\/code> method will return the status based on ID. The basic skeleton now looks like this:<\/p>\n
\r\npublic sealed class MyCommandController : ApiController\r\n{\r\n    private readonly MyCommands commands;\r\n\r\n    public MyCommandController(MyCommands commands)\r\n    {\r\n        this.commands = commands;\r\n    }\r\n\r\n    public HttpResponseMessage Post([FromUri] MyCommandParameters p)\r\n    {\r\n        return this.Request.CreateResponse(HttpStatusCode.Accepted, this.commands.Start(p));\r\n    }\r\n\r\n    public MyCommandResult Get(string id)\r\n    {\r\n        return this.commands.Get(id);\r\n    }\r\n}\r\n<\/pre>\n
Note the use of a new data type MyCommandResult<\/code> to wrap the original command completion message. This is so we can allow programmatic detection of the pending\/finished state to aid in client polling.<\/p>\n
To make the routes look nice, we would want the experience of calling POST<\/code> on api\/MyCommand\/<\/code> and GET<\/code> on api\/MyCommand\/id<\/strong><\/code>. This is relatively easy in Web API by using convention-based routing<\/a>:<\/p>\n
\r\n            config.Routes.MapHttpRoute(\r\n                name: "DefaultApi",\r\n                routeTemplate: "api\/{controller}\/{id}",\r\n                defaults: new { id = RouteParameter.Optional });\r\n<\/pre>\n
Let’s create the MyCommands<\/code> class next. This is where all the Process<\/code> functionality will now live:<\/p>\n
\r\npublic sealed class MyCommands\r\n{\r\n    private readonly ConcurrentDictionary<string, Process> commands;\r\n\r\n    public MyCommands()\r\n    {\r\n        this.commands = new ConcurrentDictionary<string, Process>();\r\n    }\r\n\r\n    public string Start(MyCommandParameters p)\r\n    {\r\n        Process myCommand = Process.Start(\r\n            "MyCommand.exe",\r\n            $"-useTheForce {p.useTheForce} -timeout {p.timeout} -auditMessage {p.auditMessage}");\r\n        string id = Guid.NewGuid().ToString();\r\n        this.commands[id] = command;\r\n        return id;\r\n    }\r\n\r\n    public MyCommandResult Get(string id)\r\n    {\r\n        Process command;\r\n        if (!this.commands.TryGetValue(id, out command))\r\n        {\r\n            return MyCommandResult.NotFound(id);\r\n        }\r\n\r\n        if (!command.HasExited)\r\n        {\r\n            return MyCommandResult.Pending(id);\r\n        }\r\n\r\n        return MyCommandResult.Completed(id, command.ExitCode);\r\n    }\r\n}\r\n<\/pre>\n
We are using a ConcurrentDictionary<\/a> to store the ID to Process mapping, since many parallel requests could come in and we do not want to corrupt our state. The results are generated using MyCommandResult via the named constructor idiom<\/a>:<\/p>\n
\r\npublic sealed class MyCommandResult\r\n{\r\n    private MyCommandResult(string id, MyCommandStatus status, string detail)\r\n    {\r\n        this.Id = id;\r\n        this.Status = status;\r\n        this.Detail = detail;\r\n    }\r\n\r\n    public string Id { get; }\r\n\r\n    public MyCommandStatus Status { get; }\r\n\r\n    public string Detail { get; }\r\n\r\n    public static MyCommandResult NotFound(string id)\r\n    {\r\n        return new MyCommandResult(id, MyCommandStatus.NotFound, $"The command {id} was not found.");\r\n    }\r\n\r\n    public static MyCommandResult Pending(string id)\r\n    {\r\n        return new MyCommandResult(id, MyCommandStatus.Pending, $"The command {id} is still running.");\r\n    }\r\n\r\n    public static MyCommandResult Completed(string id, int exitCode)\r\n    {\r\n        return new MyCommandResult(id, MyCommandStatus.Completed, $"The command {id} completed with exit code {exitCode}.");\r\n    }\r\n}\r\n<\/pre>\n
Finally, the simple status enum for this three-value model<\/a>:<\/p>\n
\r\npublic enum MyCommandStatus\r\n{\r\n    NotFound,\r\n    Pending,\r\n    Completed\r\n}\r\n<\/pre>\n
Admittedly, we have added dozens more lines of code using this approach. But the payoff is improved concurrency, efficiency, and flexibility. In any case, the extra code is certainly not complex — one might even say it is simple to read and write<\/a>.<\/p>\n
So, are we done? Not yet, I’m afraid. Since our controller no longer has a public parameterless constructor, the default resolver<\/a> will not be able to instantiate it for us anymore. Rather than go to a full blown DI container<\/a> like Unity<\/a>, I generally prefer to hand-code a simple HTTP controller activator<\/a> such as in Mark Seemann’s example<\/a>. For this situation, the following will suffice:<\/p>\n
\r\nusing System;\r\nusing System.Net.Http;\r\nusing System.Web.Http.Controllers;\r\nusing System.Web.Http.Dispatcher;\r\n\r\ninternal sealed class MyActivator : IHttpControllerActivator\r\n{\r\n    private readonly MyCommands commands;\r\n\r\n    public MyActivator(MyCommands commands)\r\n    {\r\n        this.commands = commands;\r\n    }\r\n\r\n    public IHttpController Create(HttpRequestMessage request, HttpControllerDescriptor controllerDescriptor, Type controllerType)\r\n    {\r\n        if (controllerType == typeof(MyCommandController))\r\n        {\r\n            return new MyCommandController(this.commands);\r\n        }\r\n\r\n        return null;\r\n    }\r\n}\r\n<\/pre>\n
To register the activator, you need to add one more line to your Startup.Configuration
\n<\/code> method:<\/p>\n
\r\nconfig.Services.Replace(typeof(IHttpControllerActivator), new MyActivator(new MyCommands()));\r\n<\/pre>\n
Now we have a fully functional controller with proper async operation support! If you POST<\/code>, you should quickly get back a response like so:<\/p>\n
\r\nHTTP\/1.1 202 Accepted\r\nContent-Length: 38\r\nContent-Type: application\/json; charset=utf-8\r\nDate: Sat, 29 Sep 2018 17:52:03 GMT\r\nServer: Microsoft-HTTPAPI\/2.0\r\n\r\n"dea4ce75-baed-4232-b6be-cc076aceef55"\r\n<\/pre>\n
Given the ID, you can GET<\/code> the status of the operation:<\/p>\n
\r\n\/\/ When still running...\r\n{\r\n  "Id": "dea4ce75-baed-4232-b6be-cc076aceef55",\r\n  "Status": 1,\r\n  "Detail": "The command dea4ce75-baed-4232-b6be-cc076aceef55 is still running."\r\n}\r\n\r\n\/\/ When completed...\r\n{\r\n  "Id": "dea4ce75-baed-4232-b6be-cc076aceef55",\r\n  "Status": 2,\r\n  "Detail": "The command dea4ce75-baed-4232-b6be-cc076aceef55 completed with exit code 0."\r\n}\r\n\r\n\/\/ When not found...\r\n{\r\n  "Id": "abcd",\r\n  "Status": 0,\r\n  "Detail": "The command abcd was not found."\r\n}\r\n<\/pre>\n
It functions properly, and yet there are still a few issues here. But we will dig into those next time….<\/p>\n","protected":false},"excerpt":{"rendered":"
In the previous post, I discussed a few design changes to a sample Web API controller to fix up the parameters. Here is where we ended up: public sealed class MyCommandController : ApiController { public string Post([FromUri] MyCommandParameters p) {… <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21,91],"tags":[],"class_list":["post-5531","post","type-post","status-publish","format-standard","hentry","category-async","category-design"],"_links":{"self":[{"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/posts\/5531","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/writeasync.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5531"}],"version-history":[{"count":3,"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/posts\/5531\/revisions"}],"predecessor-version":[{"id":5534,"href":"http:\/\/writeasync.net\/index.php?rest_route=\/wp\/v2\/posts\/5531\/revisions\/5534"}],"wp:attachment":[{"href":"http:\/\/writeasync.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5531"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/writeasync.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5531"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/writeasync.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5531"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}