Debian tends to be a liiiiitle bit behind Fedora and because gaming on Linux is accelerating in popularity, being ahead can provide big gains in performance.
Can you manually handle all of that? Sure. I mean I have Mint on my side desktop with a custom Kernel but I recognize that I am dropping a V8 into a Mini Van.
Why is your hobby more important than their hobby?