Give it a try.
I can tell you that after a few hrs over an open fire, there’s plenty of flavor imparted. No, you won’t have a smoke ring, but you’ll have some damn good brisket. I’ve done it over the fire pit as well as in the grill (direct heat) and both are good.
One benefit is that after the water bath you can chill the meat, still in the bag, and then finish it at your leisure. Pull the bag, put it on fire for a few hours, and it’s golden.
To your point about not taking flavor here is what Kenji Lopez-alt had to say about it on serious eats:
Is it better to apply that smoke before or after cooking sous vide? Well, according to folks like Meathead Goldwyn, author of the eponymous book Meathead: The Science of Great Barbecue and Grilling at Amazon, the flavorful compounds in smoke will adhere to and penetrate raw meat much better than they will cooked meat. This is true, but I find that the amount of smoke flavor I get out of a post–sous vide session in the smoker is plenty for my taste buds, and smoking at the end makes the process so much more efficient. I'll stick to the post–sous vide smoke.
https://www.seriouseats.com/sous-vide-barbecue-smoked-bbq-brisket-texas-recipe#toc-to-smoke-or-not-to-smoke
They also suggest a little pink salt in the bag during the sous vide to get the “smoke” ring, but that juice isn’t worth the squeeze, IMHO.