Again: Don’t ever create This is done pretty easily when reading in files. Maybe you’ve got files At this point, most R beginners will use a A more R-native way to do it is with Either way, it’s handy to name the list elements to match the files<\/p>\n This is super-easy, the base function This is also a nice way to break a data frame into pieces for cross-validation. Maybe you want to split Maybe you’re simulating data, something like this:<\/p>\n But who does only one simulation? You want to do this 100 times, 1000 times, more! But you don’t<\/em>want 10,000 data frames in your workspace. Use In this case especially, you should also consider whether you really need separate data frames, or would a single data frame with a “group” column work just as well? Using If you have data frames named in a pattern, e.g., You should start off double checking just the Put similar data in lists because you probably want to do similar things to each data.frame, and functions like A couple common tasks might be combining them. If you want to stack them on top of each other, you could use Think of scalability. If you really only need three variables, it’s fine to use Even if you use a lowly for loop, it’s much easier to loop over the elements of a list than it is to construct variable names with You can name the elements of a list, in case you want to use something other than numeric indices to access your data frames (and you can use both, this isn’t an XOR choice).<\/p>\n Overall, using lists will lead you to write cleaner, easier-to-read code, which will result in fewer bugs and less confusion.<\/p>\n","protected":false},"excerpt":{"rendered":" Lists from the start Again: Don’t ever create d1 d2 d3 in the first place, just create a list d with 3 elements. Reading multiple… <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-862","post","type-post","status-publish","format-standard","hentry","category-r"],"_links":{"self":[{"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/posts\/862","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/comments?post=862"}],"version-history":[{"count":0,"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/posts\/862\/revisions"}],"wp:attachment":[{"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/media?parent=862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/categories?post=862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zhuoyao.net\/index.php\/wp-json\/wp\/v2\/tags?post=862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}d1<\/code> d2<\/code> d3<\/code> in the first place, just create a list d<\/code> with 3 elements.<\/p>\nReading multiple files into a list of data frames<\/h3>\n
data1.csv, data2.csv, ...<\/code> in a directory. Your goal is a list of data.frames called mydata<\/code>. The first thing you need is a vector with all the file names. You can construct this with paste (e.g., myfiles = paste0(\"data\", 1:5, \".csv\")<\/code>), but it’s probably easier to use list.files<\/code> to grab all the appropriate files: myfiles <- list.files(pattern = \"*.csv\")<\/code>.<\/p>\nfor<\/code> loop, and there’s nothing wrong with that, it works.<\/p>\nmydata <\/span><-<\/span> list<\/span>()<\/span>\nfor<\/span> (<\/span>i <\/span>in<\/span> seq_along<\/span>(<\/span>myfiles<\/span>))<\/span> {<\/span>\n mydata<\/span>[[<\/span>i<\/span>]]<\/span> <-<\/span> read.csv<\/span>(<\/span>file <\/span>=<\/span> myfiles<\/span>[<\/span>i<\/span>])<\/span>\n}<\/span><\/code><\/pre>\nlapply<\/code><\/p>\nmydata <\/span><-<\/span> lapply<\/span>(<\/span>myfiles<\/span>,<\/span> read.csv<\/span>)<\/span><\/code><\/pre>\nnames<\/span>(<\/span>mydata<\/span>)<\/span> <-<\/span> gsub<\/span>(<\/span>\"\\\\.csv\"<\/span>,<\/span> \"\"<\/span>,<\/span> myfiles<\/span>)<\/span>\n# or, if you prefer the consistent syntax of stringr<\/span>\nnames<\/span>(<\/span>mydata<\/span>)<\/span> <-<\/span> stringr<\/span>::<\/span>str_replace<\/span>(<\/span>myfiles<\/span>,<\/span> pattern <\/span>=<\/span> \".csv\"<\/span>,<\/span> replacement <\/span>=<\/span> \"\"<\/span>)<\/span><\/code><\/pre>\nSplitting a data frame into a list of data frames<\/h3>\n
split()<\/code> does it for you. You can split by a column (or columns) of the data, or by anything else you want<\/p>\nmt_list <\/span>=<\/span> split<\/span>(<\/span>mtcars<\/span>,<\/span> f <\/span>=<\/span> mtcars<\/span>$<\/span>cyl<\/span>)<\/span>\n# This gives a list of three data frames, one for each value of cyl<\/span><\/code><\/pre>\nmtcars<\/code> into training, test, and validation pieces.<\/p>\ngroups <\/span>=<\/span> sample<\/span>(<\/span>c<\/span>(<\/span>\"train\"<\/span>,<\/span> \"test\"<\/span>,<\/span> \"validate\"<\/span>),<\/span>\n size <\/span>=<\/span> nrow<\/span>(<\/span>mtcars<\/span>),<\/span> replace <\/span>=<\/span> TRUE<\/span>)<\/span>\nmtsplit <\/span>=<\/span> split<\/span>(<\/span>mtcars<\/span>,<\/span> f <\/span>=<\/span> groups<\/span>)<\/span>\n# and mtsplit has appropriate names already!<\/span><\/code><\/pre>\nSimulating a list of data frames<\/h3>\n
my.sim.data <\/span>=<\/span> data.frame<\/span>(<\/span>x <\/span>=<\/span> rnorm<\/span>(<\/span>50<\/span>),<\/span> y <\/span>=<\/span> rnorm<\/span>(<\/span>50<\/span>))<\/span><\/code><\/pre>\nreplicate<\/code> and put them in a list:<\/p>\nsim_list <\/span>=<\/span> replicate<\/span>(<\/span>n <\/span>=<\/span> 10<\/span>,<\/span>\n expr <\/span>=<\/span> {<\/span>data.frame<\/span>(<\/span>x <\/span>=<\/span> rnorm<\/span>(<\/span>50<\/span>),<\/span> y <\/span>=<\/span> rnorm<\/span>(<\/span>50<\/span>))},<\/span>\n simplify <\/span>=<\/span> F<\/span>)<\/span><\/code><\/pre>\ndata.table<\/code>, dplyr<\/code>, or plyr<\/code> it’s quite easy to do things “by group” to a data frame.<\/p>\nI didn’t put my data in a list \ud83d\ude41 I will next time, but what can I do now?<\/h3>\n
df1<\/code>, df2<\/code>, df3<\/code>, and you want them in a list, you can get them if you can write a regular expression to match the names. Something like<\/p>\ndf_list <\/span>=<\/span> lapply<\/span>(<\/span>ls<\/span>(<\/span>pattern <\/span>=<\/span> \"df[0-9]\"<\/span>),<\/span> get<\/span>)<\/span><\/code><\/pre>\nls<\/code> part and make sure you’re getting the right variables. And next time use lists from the start.<\/p>\nWhy put the data in a list?<\/h2>\n
lapply<\/code>, sapply<\/code> do.call<\/code>, and the plyr<\/code> l*ply<\/code> functions make it really easy to do that. Examples of people easily doing things with lists are all over SO.<\/p>\nrbind<\/code> for a pair of them, and do.call<\/code> with rbind<\/code>, or (for speed) dplyr::bind_rows<\/code> to put them together. (Similarly using cbind<\/code> or dplyr::bind_cols<\/code> for columns.) To merge (join) a list of data frames, you can see these answers<\/a>.<\/p>\nd1<\/code>, d2<\/code>, d3<\/code>. But then if it turns out you really need 6, that’s a lot more typing. And next time, when you need 10 or 20, you find yourself copying and pasting lines of code, maybe using find\/replace to change d14<\/code> to d15<\/code>, and you’re thinking this isn’t how programming should be<\/em>. If you use a list, the difference between 3 cases, 30 cases, and 300 cases is at most one line of code—no change at all if your number of cases is automatically detected by, e.g., how many .csv<\/code> files are in your directory.<\/p>\npaste<\/code> and access the objects with get<\/code>.<\/p>\n