Crimea is voting on whether to rejoin Russia or stay with Ukraine but with more autonomy.
The referendum has been condemned as “illegal” by Kiev and the West but is backed by Moscow.
Since the fall of Ukraine’s pro-Moscow President Viktor Yanukovych, Russian troops have in effect taken control of the majority ethnic-Russian region.
Voters are expected to support leaving Ukraine, but Crimean Tatars are boycotting the poll.
The BBC’s Ben Brown at a polling station in the Crimean capital, Simferopol, reported a strong turnout – with 100 people arriving in the first 10 minutes after polls opened.
Polling stations across Crimea opened at 08:00 local time (06:00 GMT) and will close 12 hours later.
On the ballot paper, voters are being asked whether they would like Crimea to rejoin Russia.
A second question asks whether Ukraine should return to its status under the 1992 constitution, which would give the region much greater autonomy.
Some 1.5m voters are eligible to cast their ballots, and the first results are expected to be released shortly after the referendum.
Ethnic Russians form a clear majority in the region (58.5%), and many of them are expected to vote for joining Russia.
Ahead of the vote, one woman – who was speaking on condition of anonymity – told the BBC: “We love (Russian President Vladimir) Putin and are for Russia.
“We are only for Russia. Why? Because we don’t want fascists here,” she added. The woman was referring to the warnings by Putin that “fascists” and “far-right radicals” took over in Kiev after months of protests against Yanukovych. Ukraine denies the allegation as “blatant lies”. But there are also those who would like Crimea to stay part of Ukraine but with more local powers. “In my opinion, Ukraine should have full autonomy so it can look after its own finances. There should be no pressure from the government. I favour independence,” Serhiy Reshetnyk told the BBC. Russia earlier vetoed a draft UN resolution criticising the vote – the only Security Council member to do so.
The US-drafted document was supported by 13 Council members. China, regarded as a Russian ally on many issues, abstained from the poll. Beijing has said it supports Ukraine’s territorial integrity.
The US and EU had warned they would impose further tough sanctions on Russian officials if the referendum went ahead. Russia’s envoy voted against the draft resolution at the UN Security Council Russia intervened in the Crimean peninsula by seizing control of government buildings and blocking Ukraine’s troops at their bases after the fall of President Yanukovych on 22 February. However, the Kremlin officially denies deploying extra troops there, describing them as Crimea’s “self-defence forces”. The authorities in Kiev – backed by the EU and US – have condemned the Crimea vote as “illegitimate”. They say a free vote is impossible under a “barrel of the gun”. The Ukrainian parliament has also voted to disband Crimea’s regional assembly.
But Russian Foreign Minister Sergei Lavrov said on Friday that Moscow would “respect the will of the people of Crimea”.
Speaking after marathon talks in London with US Secretary of State John Kerry, Lavrov admitted that both sides had “no common vision” on how to solve the crisis.
Lavrov said that Russia had no plans to invade south-eastern Ukraine, despite a massive military build-up on the border with its neighbour.
The Crimean region was part of Russia until 1954.
Russia’s Black Sea fleet is also based in Crimea. But Moscow has signed agreements promising to uphold Ukraine’s territorial integrity.