Building your own PC used to be cheaper, but nowadays with the price of GPUs it might sometimes make more sense to go for prebuilts instead. But first, see if you can buy secondhand - I got a PC with an RTX 1070 and a VR headset for a 60-70% markdown compared to retail price because they were looking to offload their units and recoup some costs. Likewise, someone who is upgrading their rig might be more willing to sell their old hardware for a lower price.
You won't get the top of the line and the newest shiny this way, but you will most likely get a very decent rig - and a 1070 or higher can get you VERY far for most indie game development purposes. Hell, if you're doing 2D game dev, then even a normal laptop iGPU will be more than enough most of the time.