Google announced that it has initiated legal proceedings against a large-scale fraud operation, which is stated to have been carried out by misusing the Gemini artificial intelligence platform. The company claims that a cybercrime network, reportedly based in China, uses Gemini to create fake websites and fraud campaigns targeting users. According to Google’s statement, the effects of the operation reached hundreds of thousands of people and the resulting financial losses reached millions of dollars. The company stated that, in addition to the litigation process, it is working with law enforcement and telecom operators to attempt to stop the network in question.
DeLaine Prado, Google’s chief legal officer, told the New York Times that this was the company’s first coordinated litigation effort on this scale. According to Prado, the scope of the operation in question and the impact it created led Google to act jointly with different institutions. While the company worked with the US Federal Bureau of Investigation (FBI) within the scope of the investigation, it also cooperated with major mobile operators such as AT&T, T-Mobile and Verizon.
In the lawsuit filed by Google, it is claimed that a China-based organization called “Outsider Enterprise” is carrying out fraudulent activities using the company’s technology and brand value. The company requested an injunction from the court that would stop the operations of the network in question. Allegedly, the group took advantage of Gemini’s productive artificial intelligence capabilities to create websites that imitate various institutions, especially Google and YouTube. In addition, fake platforms have been created that copy the appearance of public institutions such as the US Postal Service and the E-ZPass toll system in New York.
The size of the Gemini-supported fraud operation draws attention
According to the data shared by Google, the operation was based on a very extensive infrastructure. The company announced that approximately 9 thousand fake websites and more than 1 million fake URLs were created by the fraud network. In addition, 55 thousand text messages were detected as spam by Android users. It was stated that approximately 2.5 million messages containing links to fake sites were circulated in just a two-week period.
While Google emphasizes that all these activities are carried out by a single organization, it points out that artificial intelligence-supported fraud attempts may become more widespread in the future. For this reason, the company announced that it supports various bills aimed at combating artificial intelligence-based fraud in the USA. Supported regulations include initiatives such as the National Strategy for Combatting Scams Act, Strategic Task Force on Scam Prevention Act, STOP Scams Against Seniors Act and AI Plan Act.
Commenting on the issue, Pennsylvania Representative Brian Fitzpatrick said that what happened should not be seen as an ordinary spam campaign. Fitzpatrick stated that organized crime networks operating on an international scale operate through mobile communication channels and that a coordinated fight on a similar scale is required against this.
FBI Deputy Director Brett Leatherman stated that artificial intelligence makes fraud methods more convincing and harder to detect. According to Leatherman, criminals’ use of productive artificial intelligence tools requires security institutions and technology companies to develop more comprehensive measures. The lawsuit filed by Google also attracts attention as one of the first major initiatives in this field. However, the company has not shared detailed information about what internal security measures it has implemented to prevent the misuse of Gemini. Despite this, the litigation process shows that technology companies are starting to take a more active stance against the misuse of artificial intelligence tools.