When Visual Studio creates an ASP.NET Core 2.0 project using an Empty template, it automatically references a Microsoft.AspNetCore.All package which depends on everything (every ASP.NET related package I can think of). It seems to me that it defeats a key advantage of ASP.NET Core (being modular).
Can I make Visual Studio not include this package with every project?
The Microsoft.AspNetCore.All package is, as DavidG points out, just a meta package. Yes, it references all packages covering ASP.NET Core 2.x and Entity Framework Core 2.x., and yes that means it's huge. However these packages are not deployed with your app, unless you consider the runtime part of your app.
One of the reasons for introducing the .All meta package was to reduce the clutter in the project file, and it's done a great job of that. Now you will still get a large number of dependencies in your deps.json file unless you trim as described below, but the dll's themselves are not included.
Here are a couple of good resources:
https://learn.microsoft.com/en-us/aspnet/core/fundamentals/metapackage
https://github.com/dotnet/standard/blob/release/2.0.0/Microsoft.Packaging.Tools.Trimming/docs/trimming.md
https://andrewlock.net/the-microsoft-aspnetcore-all-metapackage-is-huge-and-thats-awesome-thanks-to-the-net-core-runtime-store-2/ - a little older as it references Preview 1, but it still applies.
Hope that helps.