convore.json/groups/python/dependencies-and-deployment/messages.json

[{"user_id": 1167, "stars": [], "topic_id": 20674, "date_created": 1303375701.648874, "message": "@ianmlewis that's what I do, with a custom index server in my requirements file (--index-url). This way I can install custom packages, forks and internal stuff", "group_id": 292, "id": 767888}, {"user_id": 4383, "stars": [{"date_created": 1304097374.5047009, "user_id": 27815}, {"date_created": 1304804943.467597, "user_id": 14057}], "topic_id": 20674, "date_created": 1303375558.3215771, "message": "I'm really curious what people do for installing dependencies during deployment of web applications. Are most folks simply creating a fabfile.py that runs pip install -r requirements.txt?", "group_id": 292, "id": 767878}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303375764.586297, "message": "Hmm, Our pypi would be at the very least behind basic auth which makes that very annoying for the projects it would work for.", "group_id": 292, "id": 767897}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303375612.0033319, "message": "I'm asking because my company has a number of internal libraries which are not released to the general public but need to be installed when deploying to servers.", "group_id": 292, "id": 767880}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303375681.805445, "message": "I've read that people set up an internal pypi and put packages but doing that for every project just for deployment is pretty cost prohibitive.", "group_id": 292, "id": 767887}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303375868.2109339, "message": "I thought about using pip bundles and uploading it to the server directly since we can almost always ssh there, but it doesn't seem to be used much and it even seems like Ian Bicking wants to remove the feature.", "group_id": 292, "id": 767909}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303375788.947598, "message": "For some of our projects the servers would not be able to access our internal pypi so it would need to be local.", "group_id": 292, "id": 767902}, {"user_id": 4893, "stars": [], "topic_id": 20674, "date_created": 1303376942.4671199, "message": "For internal projects I'd just set up a little PyPI instance (aka nginx with a few rewrite rules iirc) and use pip install -r requirements.txt. A couple of months ago I looked at a couple of options in this department and wrote a short blog post. Perhaps it gives you some ideas :-) http://zerokspot.com/weblog/2010/10/31/pypi-installations/", "group_id": 292, "id": 767979}, {"user_id": 1167, "stars": [{"date_created": 1304804954.96067, "user_id": 14057}], "topic_id": 20674, "date_created": 1303375743.1375661, "message": "an internal pypi is overkill for most of my needs. I use basketweaver to generate an index from a directory containing python packages", "group_id": 292, "id": 767893}, {"user_id": 1167, "stars": [], "topic_id": 20674, "date_created": 1303375777.7564909, "message": "http://pypi.python.org/pypi/basketweaver", "group_id": 292, "id": 767901}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303376076.2005751, "message": "@brutasse So do you generate an html file and then specify the --index-url as something like file://path/to/index.html?", "group_id": 292, "id": 767939}, {"user_id": 1167, "stars": [], "topic_id": 20674, "date_created": 1303376216.7894289, "message": "@ianmlewis no, my index is a remote server. not sure how pip deals with local indices but that should work", "group_id": 292, "id": 767949}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303378214.8835869, "message": "Or I could upload the egg/tar.gz files and an index which I could access using file://path/to/index.html and have each server install from a local index.", "group_id": 292, "id": 768104}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303378279.131711, "message": "The second option would work you can pretty much always access a server via ssh somehow, but it's pretty much the same as pip bundles anyway without the nice command that downloads and bundles the dependencies for me.", "group_id": 292, "id": 768121}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303378103.5226159, "message": "Yah, that would be ok for internal projects but my problem is mostly on remote servers (i.e. a customer's server. There are many in many different places.) that would need to access my pypi index.", "group_id": 292, "id": 768081}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303378166.1014531, "message": "I deploy I could have it access a centrally located pypi through some kind of authorization process (basic auth or somesuch) which doesn't really buy me anything since the network setup sometimes prevents that anyway.", "group_id": 292, "id": 768094}, {"user_id": 29843, "stars": [], "topic_id": 20674, "date_created": 1303471041.505029, "message": "I suggest you to take a look at zc.buildout.", "group_id": 292, "id": 780783}, {"user_id": 7375, "stars": [{"date_created": 1303528396.325074, "user_id": 9262}], "topic_id": 20674, "date_created": 1303511343.8082299, "message": "We usually use zc.buildout and point it at our own package index made with the aforementioned basketweaver or compoze <http://docs.repoze.org/compoze>", "group_id": 292, "id": 785706}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303518523.219928, "message": "Heh. Sorry. I'm done messing with buildout and I won't get into the numerous reasons here.", "group_id": 292, "id": 786283}, {"user_id": 12831, "stars": [], "topic_id": 20674, "date_created": 1303521554.120223, "message": "Rolled one 6-sided die: 3", "group_id": 292, "id": 786545}, {"user_id": 19403, "stars": [], "topic_id": 20674, "date_created": 1303572434.3168421, "message": "http://www.depot.io/", "group_id": 292, "id": 789507}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1303582950.1638701, "message": "Also what about pip freezed packages! You can bundle up one big egg to depot to your server.", "group_id": 292, "id": 790471}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1303582889.340497, "message": "@ianmlewis you should write in another thread why. Others are in a similar boat.", "group_id": 292, "id": 790460}, {"user_id": 1736, "stars": [], "topic_id": 20674, "date_created": 1303587577.0087099, "message": "@ssutch Not sure what you mean, but `pip freeze` doesn't output some kind of code bundle, it is just computes the active package set as seen from the current env.", "group_id": 292, "id": 790726}, {"user_id": 8391, "stars": [], "topic_id": 20674, "date_created": 1303596247.0858669, "message": "@coderanger: `pip bundle`", "group_id": 292, "id": 791433}, {"user_id": 1736, "stars": [], "topic_id": 20674, "date_created": 1303599018.9126689, "message": "@kennethreitz That isn't an egg exactly ;-)", "group_id": 292, "id": 791823}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303633560.800889, "message": "I mentioned using pip bundles earlier which would work for me. But Ian Bicking has written that he thinks they haven't gone anywhere and that the feature could be deleted from pip.", "group_id": 292, "id": 793526}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303714289.7545781, "message": "Bundles also seem to have a bug where if you install an editable package from a repository, installing the bundle again doesn't update the package :(", "group_id": 292, "id": 800585}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303714210.0379109, "message": "@jeffrey https://github.com/pypa/pip/issues/236", "group_id": 292, "id": 800579}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1303714314.283015, "message": "Right now I have to blow away the virtualenv and reinstall dependencies from scratch :(", "group_id": 292, "id": 800586}, {"user_id": 31204, "stars": [{"date_created": 1303914098.4497819, "user_id": 31151}, {"date_created": 1304062671.3826399, "user_id": 6836}], "topic_id": 20674, "date_created": 1303839555.356992, "message": "We create a virtualenv via a setuptools hook (setup.py release), which then installs all dependencies via pip, then creates a named & versioned tarball of the virtualenv for deployment.", "group_id": 292, "id": 816971}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1304038178.1804731, "message": "That's an interesting approach. Part the reason I like the bundle approach is that I can create the bundle once beforehand and then reuse it when deploying. i.e. Without using pypi at deploy time.", "group_id": 292, "id": 849246}, {"user_id": 4383, "stars": [], "topic_id": 20674, "date_created": 1304038231.1251111, "message": "You could probably do the same thing with a local virtualenv though the problem is that if you install any modules with C extensions they will get uploaded in their compiled binary form which may be a problem.", "group_id": 292, "id": 849255}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1304383818.8582449, "message": "and http://ssutch.org/chishop-epio which is a guide to setting up your own pypi server", "group_id": 292, "id": 891420}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1304383782.501698, "message": "http://ssutch.org/requisite", "group_id": 292, "id": 891406}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1304383780.580415, "message": "I wrote a couple blog entries on this subject recently.", "group_id": 292, "id": 891403}, {"user_id": 27283, "stars": [], "topic_id": 20674, "date_created": 1304383809.3217871, "message": "(which uploads your frozen requirements file to a pypi server)", "group_id": 292, "id": 891415}]