Yes. Even if the credit card issuer does not charge you a fee for ATM withdrawals, the ATM you use can charge you. Everything gets even worse when you use the ATM that does not belong to your bank or credit issuer’s ATM network: you will be charged two fees, by your creditor and by the ATM.
The issuers also charge APR for cash advance, which are rather high and have no grace period, so the interest starts accrue immediately.
So it is worth to contact your credit issuer and ask how much does it charge.