Scaling Laws for Data Filtering–Data Curation cannot be Compute Agnostic

Tofu: A task of fictitious unlearning for llms

Massive Activations in Large Language Models

Forcing Diffuse Distributions out of Language Models

Rethinking LLM Memorization through the Lens of Adversarial Compression

Carnegie Mellon University founder Andrew Carnegie said: "My heart is in the work."

No statement better captures the passion and drive of our people to make a real difference. 

At Carnegie Mellon, we're not afraid of the work.

Our educational environment creates problem solvers, drivers of innovation and pioneers in technology and the arts.  

Employers in every field say our graduates are ready to hit the ground running the day they graduate. 

So, join us. Whether you're looking for a career or an education. Or both.

Carnegie Mellon University

Zico Kolter is a Professor of Computer Science and the head of the Machine Learning Department at Carnegie Mellon University, where he has been a key figure for 12 years. Zico completed his Ph.D. in computer science at Stanford University in 2010, followed by a postdoctoral fellowship at MIT from 2010 to 2012. Throughout his career, he has made significant contributions to the field of machine learning, authoring numerous award-winning papers at prestigious conferences such as NeurIPS, ICML, and AISTATS.

Zico's research includes developing the first methods for creating deep learning models with guaranteed robustness. He pioneered techniques for embedding hard constraints into AI models using classical optimization within neural network layers. More recently, in 2023, his team developed innovative methods for automatically assessing the safety of large language models (LLMs), demonstrating the potential to bypass existing model safeguards through automated optimization techniques. Alongside his academic pursuits, Zico has worked closely within the industry throughout his career, formerly as Chief Data Scientist at C3.ai, and currently as Chief Expert at Bosch and Chief Technical Advisor at Gray Swan, a startup specializing in AI safety and security.

Articifical Intelligence

AI Models

Machine Learning

Deep Learning

Neural Networks

Large Language Models, Generative AI

Elections

Carnegie Mellon University Profile

Personal Website

Power Shift: How CMU Is Leading America’s Energy Evolution

Small Language Models Are the New Rage, Researchers Say

How researchers broke ChatGPT and what it could mean for future AI development

The AI Agent Era Requires a New Kind of Game Theory

Meet Alphalab’s 2025 cohort of innovative Pittsburgh startups

From emotional bonds with chatbots to the impact of AI on government jobs

Pittsburgh’s AI-Powered Renaissance

Zico Kolter Joins OpenAI’s Board of Directors

Can smart solutions be artificial? They sure can!

LLMs Pose Major Security Risks, Serving As ‘Attack Vectors’

Speaker: AI Horizons Keynote: AI for a Better World – Navigating Truth in the AI Era

Moderator: AI in Financial Services: Transforming the Sector for a Better World

power-shift-how-cmu-is-leading-americas-energy-evolution

In the heart of Pittsburgh, a quiet revolution is underway.

Associate Professor and Director of Machine Learning

Assistant Professor, Computer Science

Data Center Design

Aritficial Intelligence

Systems

Security and Privacy

Computer Architecture

University Professor

Quantitative Policy Analysis

Risk Analysis

Environmental Systems

Climate Change

Adoption of New Technologies

Trustees Professor of Security and Technology Director, Carnegie Mellon Institute for Security and Technology

National and International Security

Technology and Security

Innovation

Terrorism

Professor, Electrical and Computer Engineering

Network Monitoring and Measurement

Cybersecurity

Information Networking

Security and Systems

Networking

Network Security

Distributed Systems

Computer Security

Content/Video Delivery Systems

Middleboxes

Energy Grid Security

Department Head Professor, Electrical and Computer Engineering

Integrated Circuits

Power Systems

Secure Hardware

 Carnegie Mellon University, long known for its prowess in computer science and engineering, is now emerging as a key innovator within America’s energy landscape. As AI models grow more powerful, so too does their appetite for energy, straining an aging and outdated grid and prompting urgent questions about infrastructure, security and access. From reimagining AI data centers to modernizing and securing the electric grid, CMU researchers are working on practical solutions to pressing challenges in how the U.S. produces, moves and secures energy.

Learn what CMU experts have to say about their Work That Matters.

 

pittsburghs-aipowered-renaissance

CMU experts explain why Pittsburgh is poised to lead the industrial revolution in human-first AI

Associate Professor

Artifical Intelligence

Water

Sustainability

Resource Management

International Management

Environmental Economics

Emerging Markets

Economic Modeling

China

Asia

Biotechnology

Economic Development

Energy

Globalization

Political Economy

Strategy

Associate Professor, Machine Learning

Algorithms

Computational Biology

Bioinformatics

Data Mining

CEO, Advanced Robotics for Manufacturing (ARM) Institute

Artificial Intelligence

Semiconductor Manufacturing

Supply Chain Management

Government Relations

Robotics

Associate Director and Assistant Teaching Professor, Information Networking Institute

Data Security and Privacy

Security of AI and ML

AI Engineering

National Security

AI and ML for Security

Associate Teaching Professor of Entrepreneurship

Venture Capital

Entrepreneurship

Family Business Succession

Non-Profit Organizations

Spirits

Carnegie Mellon University’s artificial intelligence experts come from a wide range of backgrounds and perspectives, representing fields including computer science, sustainability, national security and entrepreneurship.  

Ahead of the AI Horizons Summit highlighting the city's commitment to responsible technology, CMU experts weighed in on why they see Pittsburgh as a hub for human-centered AI.

 


https://www.cmu.edu/whats-next-podcast/all-episodes/s2-episode-14-guiding-safe-future-ai-part-1

What if AI is automating the one thing that's always made us human—Intelligence itself? And how do we ensure that it's developed safely?

In this first of a two-part series, we speak with Dr. Zico Kolter, head of Carnegie Mellon University's Machine Learning Department and newly appointed OpenAI board member, where he chairs their Safety and Security Committee, to explore the critical challenge of developing artificial intelligence safely. 

Dr. Kolter discusses CMU's pioneering machine learning department and outlines four essential categories of AI safety concerns: immediate security threats like data exfiltration and prompt injection; societal impacts on jobs, economy, and mental health; catastrophic risks from malicious actors wielding AI-powered capabilities; and long-term scenarios of uncontrollable superintelligence.

Unlike previous technological revolutions that automated physical labor or computation, AI represents something unprecedented—the automation of intelligence itself. Dr. Kolter argues this fundamental difference demands collaborative oversight from industry, academia, and government to ensure AI serves humanity's best interests. The conversation emphasizes why getting AI safety right matters more than ever as we integrate thinking machines into our critical infrastructure.

Learn more about CMU Expert Zico Kolter's work that matters: https://www.cmu.edu/news/experts/zico.kolter

Guiding a Safe Future for AI – Part 1

Welcome to our new episode, where we explore the potential of AI in transforming industries and discuss how to regulate this rapidly evolving technology without stifling innovation. 

On this episode, your host Sanjay Puri is joined by Professor Zico Kolter, Professor and Director of the Machine Learning Department at Carnegie Mellon University and Chief Expert at Bosch USA, who shares his insights on AI regulation and its challenges.

About Regulating AI:
RegulatingAI is a dedicated non-profit organization designed for experts, mentors, and users of artificial intelligence (AI) with a keen interest in exploring the intersection of AI and regulation. We aim to unite individuals with diverse expertise and backgrounds, fostering collaboration to collectively advance the understanding and implementation of AI regulations.

Key Takeaways:
00:00 - 03:59 Introductions
02:41 - 04:00 AI innovation outpaces legislation. 
04:00 - 6:36 Regulating technology vs. its usage is crucial. 
06:36 - 11:14 AI is advancing faster than ever. 
11:14 - 15:30 Companies must prevent AI misuse. 
15:30 - 21:34 Bias-free algorithms are not feasible. 
21:34 - 27:49 Human interaction in AI decisions is essential. 
27:49  - 32:26 The competitive environment benefits AI development. 
32:26 - 37:52 Perfectly accepted regulations indicate mistakes. 
37:52 - 42:49 Regulations should adapt to technological changes. 
42:49 - 45:16 AI developers aim to benefit people.
45:16 - 46:30 Human-in-the-loop AI is crucial for reliability. 
46:30 Addressing gaps in AI systems is critical.

Resources Mentioned:
Zico Kolter - https://www.linkedin.com/in/zico-kolter-560382a4/
Carnegie Mellon University - https://www.linkedin.com/school/carnegie-mellon-university/
Bosch USA - https://www.linkedin.com/company/boschusa/
EU AI Act - https://ec.europa.eu/digital-strategy/our-policies/eu-regulatory-framework-artificial-intelligence_en
OpenAI - https://www.openai.com/

About your host
Sanjay Puri is a recognized authority on US-India relations. He serves as the Chairman of the US-India Political Action Committee (USINPAC), a national, bipartisan political action committee representing Indian-Americans.  He is also the founder of the Alliance for US India Business (AUSIB), an organization dedicated to strengthening economic ties between the US and India.  He is also a successful technology entrepreneur, mentor, and investor.

Thanks for listening to the Regulating AI: Innovate Responsibly podcast. If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation.

#AIRegulation #regulatingaipodcast #innovationinAIRegulation

Streaming On: 
Apple Podcast: https://podcasts.apple.com/us/podcast/regulating-ai-innovate-responsibly/id1714410167
Spotify: https://open.spotify.com/show/3ZkXYPINugnegkORcBCrYo?si=a7ad672e8e194bea
YouTube: https://www.youtube.com/@The_Regulating_AI_Podcast

Join our fastest-growing AI Community:
Discord: https://discord.com/invite/DTzB9YvPqV
Instagram: https://www.instagram.com/regulating_ai/
Twitter: https://twitter.com/RegulatingAI
LinkedIn: https://www.linkedin.com/company/regulating-ai
Facebook: https://www.facebook.com/RegulatingAI
Read Our Blogs, News & Updates:https://regulatingai.org/

Join the Conversation:
Leave your thoughts and questions in the comments below. We'd love to hear from you!

Balancing Innovation and Regulation in AI with Zico Kolter | Regulating AI Podcast

What would you say to someone who is afraid of artificial intelligence (AI)? 

Thought leaders in AI: Zico Kolter | Presented by Bosch

On March 29, Dr. Zico Kolter, CMU's assistant professor of School of Computer Science, delivered an Andy Talk titled, "Energy & Data: The Personal and The Global."

Kolter's presentation was part of Carnegie Mellon's 2017 Energy Week. During the Andy Talks, eight CMU faculty members explained their energy-related research in brief 20-minute presentations.

For information on future events, visit http://www.cmu.edu/energy and sign up for monthly updates on these events and Scott Institute news at www.tinyurl.com/scottnews. Listen to our 90-second radio show, Energy Bite, at http://www.energybite.org or get it on iTunes!

Like us on Facebook @scottinstitute and follow us on Twitter @cmuenergy! Alumni and students, join our LinkedIn Group, Carnegie Mellon Energy Alumni.

Please click "Subscribe" on our Youtube channel to watch more lectures!

Dr. Zico Kolter: Energy &amp; Data: The Personal and The Global

Media Inquiry