Probabilistic methods have revolutionized the study of number theory, offering powerful tools for understanding the distribution of prime numbers and other fundamental properties of integers. This paper provides an overview of probabilistic methods in number theory, focusing on recent developments and applications. We begin with a discussion of the basic concepts in number theory, including prime numbers, divisibility, and congruences. We then explore the history and background of probabilistic methods, highlighting key developments such as the probabilistic prime number theorem and random matrix theory. Next, we discuss applications of probabilistic methods in prime number distribution and the use of random matrix models in number theory. We also examine recent advances in probabilistic number theory, including new results and conjectures. Finally, we discuss the challenges and future directions of probabilistic number theory, including computational challenges, bridging the gap between theory and practice, and the potential for further innovation.