Go to the Effects & Presets panel, search for "Instant 4K," and drag it onto your video layer. Configure Settings:
Instant 4K Plugin for After Effects: The Ultimate Guide to Upscaling instant 4k plugin after effects
Use a setting around 3 to smooth out jagged edges without making the image look soft. Go to the Effects & Presets panel, search