Are you parallelizing your raster operations? You should!

If you plan to do anything with the raster package you should definitely consider parallelize all your processes, especially if you are working with very large image files. I couldn’t find any blog post describing how to parallelize with the raster package (it is well documented in the package documentation, though). So here my notes.
(more…)

Thursday, 17 January 2019

tweets


Twitter: frbailo

links


blogroll


RSS r-bloggers.com

  • Why Machine Learning is more Practical than Econometrics in the Real World
    Motivation I’ve read several studies and articles that claim Econometric models are still superior to machine learning when it comes to forecasting. In the article, “Statistical and Machine Learning forecasting methods: Concerns and ways forward”, the author mentions that, “After comparing the post-sample accuracy of popular ML methods with that of eight traditional statistical ones, we […]
  • No visible binding for global variable
    Recently I have been working on a very large legacy project which utilises the excellent data.table package throughout. What this has resulted in is an R CMD check containing literally thousands of NOTEs similar to the following: ❯ checking R code for possible problems ... NOTE my_fn: no visible binding for global variable ‘mpg’ There […]
  • Mueller Report Volume 1: Network Analysis
    settle down and have another cup of coffee code TLDR There are a lot of Russian’s talking to a lot of Trump campaign members in Mueller report. There are so many it’s tough to get your head around it all. In this post I attempted some network analysis on the relations between campaign officials and […]
  • Dash with golem: The beginning
    {golem} has been developed to help building big Shiny application to put in production. What if {golem} could be used to build another popular interactive web application, recently made available to R programmers: Dash ? Dash, a newcomer in interactive...
  • How To Select Multiple Columns Using Grep & R
    Why you need to be using Grep when programming with R. There’s a reason that grep is included in most if not all programming language to... The post How To Select Multiple Columns Using Grep & R appeared first on FinderDing.

RSS Simply Statistics

  • The data deluge means no reasonable expectation of privacy - now what?
    Today a couple of different things reminded me about something that I suppose many people are talking about but has been on my mind as well. The idea is that many of our societies social norms are based on the reasonable expectation of privacy. But the reasonable expectation of privacy is increasingly a thing of […]
  • More datasets for teaching data science: The expanded dslabs package
    Introduction We have expanded the dslabs package, which we previously introduced as a package containing realistic, interesting and approachable datasets that can be used in introductory data science courses. This release adds 7 new datasets on climate change, astronomy, life expectancy, and breast cancer diagnosis. They are used in improved problem sets and new projects […]
  • Research quality data and research quality databases
    When you are doing data science, you are doing research. You want to use data to answer a question, identify a new pattern, improve a current product, or come up with a new product. The common factor underlying each of these tasks is that you want to use the data to answer a question that […]

RSS Statistical Modeling, Causal Inference, and Social Science

  • “The issue of how to report the statistics is one that we thought about deeply, and I am quite sure we reported them correctly.”
    Ricardo Vieira writes: I recently came upon this study from Princeton published in PNAS: Implicit model of other people’s visual attention as an invisible, force-carrying beam projecting from the eyes In which the authors asked people to demonstrate how much you have to tilt an object before it falls. They show that when a human […]
  • “I feel like the really solid information therein comes from non or negative correlations”
    Steve Roth writes: I’d love to hear your thoughts on this approach (heavily inspired by Arindrajit Dube’s work, linked therein): This relates to our discussion from 2014: My biggest takeaway from this latest: I feel like the really solid information therein comes from non or negative correlations: • It comes before • But it doesn’t […]
  • What can be learned from this study?
    James Coyne writes: A recent article co-authored by a leading mindfulness researcher claims to address the problems that plague meditation research, namely, underpowered studies; lack of or meaningful control groups; and an exclusive reliance on subjective self-report measures, rather than measures of the biological substrate that could establish possible mechanisms. The article claims adequate sample […]