3.10 Pipeline Construction
20210103 Continuing with our pipeline example, we might want a base::summary() of the dataset.
# Summarise subset of variables for observations with rainfall.
ds %>%
select(min_temp, max_temp, rainfall, sunshine) %>%
filter(rainfall >= 1) %>%
summary()## min_temp max_temp rainfall sunshine
## Min. :-8.50 Min. :-4.10 Min. : 1.000 Min. : 0.000
## 1st Qu.: 8.40 1st Qu.:15.60 1st Qu.: 2.200 1st Qu.: 2.300
## Median :12.20 Median :19.30 Median : 4.800 Median : 5.400
## Mean :12.73 Mean :20.21 Mean : 9.859 Mean : 5.332
## 3rd Qu.:17.10 3rd Qu.:24.50 3rd Qu.: 11.200 3rd Qu.: 8.100
## Max. :28.90 Max. :46.30 Max. :474.000 Max. :14.200
....It could be useful to contrast this with a base::summary() of those observations where there was little or no rain.
# Summarise observations with little or no rainfall.
ds %>%
select(min_temp, max_temp, rainfall, sunshine) %>%
filter(rainfall < 1) %>%
summary()## min_temp max_temp rainfall sunshine
## Min. :-8.7 Min. :-2.1 Min. :0.00000 Min. : 0.000
## 1st Qu.: 7.2 1st Qu.:19.0 1st Qu.:0.00000 1st Qu.: 6.100
## Median :11.8 Median :23.7 Median :0.00000 Median : 9.300
## Mean :11.9 Mean :24.2 Mean :0.05998 Mean : 8.354
## 3rd Qu.:16.6 3rd Qu.:29.1 3rd Qu.:0.00000 3rd Qu.:11.000
## Max. :33.9 Max. :49.6 Max. :0.90000 Max. :14.500
....Any number of functions can be included in a pipeline to achieve the results we desire. In the following chapters we will see many examples and some will string together ten or more functions. Each step along the way is of itself generally easily understandable. The power is in what we can achieve by stringing together many simple steps to produce something more complex.
If you find this curated material useful then you can consider a donation to support it's ongoing availability and give you access to the PDF version of this book. The material has been scoped up by Generative AI without permission or any kind of recompense so do consider a donation if you can afford it. Unlike Generative AI your access to this materials is freely given. Desktop Survival Guides include Data Science, GNU/Linux, and MLHub. Books available on Amazon include Data Mining with Rattle and Essentials of Data Science. Togaware has a 30 year tradition of making popular open source software which includes sold privacy preserving productivity apps, rattle, wajig, and mlhub. Hosted by Togaware, a pioneer of free and open source software since 1984. Copyright © 1995-2022 Graham.Williams@togaware.com Creative Commons Attribution-ShareAlike 4.0
