This issue is clear cut for me.
If a lady has chosen this career for herself, there is absolutely zero problem with it.
If a lady or girl has been coerced into it, I do have a problem with it.
I would assume that ladies being coerced into it are much less common in Japan and similar countries. Who cares if a prostitute can't tell her family about her job? That's her own fucking choice too. Maybe she is proud of her work but just doesn't want to deal with the drama of her prude family losing their shit. But in a country where a lot of trafficking exists (eg, Cambodia), I wouldn't choose to see a prostitute.
I know these are large sweeping generalisations (there may be some cases in Japan where women are coerced, and some independent career prostitutes in Cambodia), but that's kind of how I see the issue. The problem is, a lot of people just see it as "prostitution", one big umbrella that includes all of it. But you can't view them the same way.