A systematic method for mapping deterministic chaos in general, and atmospheric and climate dynamics in particular, into a Markovian process is developed. The possibility of using the Markovian description for carrying out long-term statistical predictions is suggested, and illustrated on simple models and on data pertaining to sea surface temperature anomalies which can be reduced to one-dimensional maps.