Or at least not automatically. A company established outside the EU does not have a fixed establishment for VAT purposes in an EU Member...
In Case C-547/18, Dong Yang Electronics, the ECJ has been asked to revisit the definition of fixed establishment (FE) for VAT purposes...