Usually when choosing a framework for a software development or data analysis task, you have to make tradeoffs. Frameworks like Spark often bring you more power and scalability, but at the cost of added complexity. This is sometimes phrased as “making the easy things hard and the hard things easy”.