Short answer
HubSpot's KB: after installing the HubSpot All-In-One Marketing WordPress plugin, create a chatflow and target the WordPress pages specifically in its settings.
1. In HubSpot
The relevant screen in my demo portal.

2. Worth knowing
If it doesn't appear, check targeting and availability.
3. Related
Chat widget not appearing and the plugin.